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PREFACE 



/ hold every man a debtor 
to his profession, 
from the which as men of course 
doe seeke to receive countenance and profit, 
so ought they of duty to endeavour 
themselves by way of amends, 
to be a help and 
ornament thereunto. 



FRANCIS BACON 



Every aspect of this book was influenced by the desire to present calculus not 
merely as a prelude to but as the first real encounter with mathematics. 
Since the foundations of analysis provided the arena in which modern modes 
of mathematical thinking developed, calculus ought to be the place in which 
to expect, rather than avoid, the strengthening of insight with logic. In addi- 
tion to developing the students' intuition about the beautiful concepts of 
analysis, it is surely equally important to persuade them that precision and 
rigor are neither deterrents to intuition, nor ends in themselves, but the 
natural medium in which to formulate and think about mathematical 
questions. 

This goal implies a view of mathematics which, in a sense, the entire book 
attempts to defend. No matter how well particular topics may be developed, 
the goals of this book will be realized only if it succeeds as a whole. For this 
reason, it would be of little value merely to list the topics covered, or to men- 
tion pedagogical practices and other innovations. Even the cursory glance 
customarily bestowed on new calculus texts will probably tell more than any 
such extended advertisement, and the teacher with strong feelings about 
particular aspects of calculus will know just where to look to see if this book 
fulfills his requirements. 

A few features do require explicit comment, however. Of the twenty-nine 
chapters in the book, two (starred) chapters are optional, and the three chap- 
ters comprising Part V have been included only for the benefit of those 
students who might want to examine on their own a construction of the real 
numbers. Moreover, the appendices to Chapters 3 and 1 1 also contain optional 
material. 

The order of the remaining chapters is intentionally quite inflexible, since 
the purpose of the book is to present calculus as the evolution of one idea, not 
as a collection of "topics." Since the most exciting concepts of calculus do not 
appear until Part III, I should point out that Parts I and II will probably 
require less time than their length suggests — although the entire book covers 
a one-year course, the chapters are not meant to be covered at any uniform 
rate. A rather natural dividing point does occur between Parts II and III, so 
it is possible to reach differentiation and integration even more quickly by 
treating Part II very briefly, perhaps returning later for a more detailed 
treatment. This arrangement corresponds to the traditional organization 
of most calculus courses, but I feel that it will only diminish the value of the 
book for students who have seen a small amount of calculus previously, and 
for bright students with a reasonable background. 

The problems have been designed with this particular audience in mind. 
They range from straightforward, but not overly simple, exercises- which 
develop basic techniques and test understanding of concepts, to problems of 
considerable difficulty and, I hope, of comparable interest. There are about 
625 problems in all. Those which emphasize manipulations usually contain 
many examples, numbered with small Roman numerals, while small letters 
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are used to label interrelated parts in other problems. Some indication of 
relative difficulty is provided by a system of starring and double starring, but 
there are so many criteria for judging difficulty, and so many hints have been 
provided, especially for harder problems, that this guide is not completely 
reliable. Many problems are so difficult, especially if the hints are not con- 
sulted, that the best of students will probably have to attempt only those which 
especially interest them; from the less difficult problems it should be easy to 
select a portion which will keep a good class busy, but not frustrated. The 
answer section contains solutions to about half the examples from an assort- 
ment of problems that should provide a good test of technical competence. A 
separate answer book contains the solutions of the other parts of these prob- 
lems, and of all the other problems as well. Finally, there is a Suggested Read- 
ing list, to which the problems often refer, and an index of symbols. 

I am grateful for the opportunity to mention the many people to whom I 
owe my thanks. Mrs. Jane Bjorkgren performed prodigious feats of typing^ 
that compensated for my fitful production of the manuscript. Mr. Richard 
Serkey helped collect the material which provides historical sidelights in the 
problems, and Mr. Richard Weiss supplied the answers appearing in the 
back of the book. I am especially grateful to my friends Michael Freeman, 
Jay Goldman, Anthony Phillips, and Robert Wells for the care with which 
they read, and the relentlessness with which they criticized, a preliminary 
version of the book. Needless to say, they are not responsible for the deficien- 
cies which remain, especially since I sometimes rejected suggestions which 
would have made the book appear suitable for a larger group of students. 
I must express my admiration for the editors and staff of W. A. Benjamin, Inc., 
who were always eager to increase the appeal of the book, while recognizing 
the audience for which it was intended. 

The inadequacies which preliminary editions always involve were gallantly 
endured by a rugged group of freshmen in the honors mathematics course at 
Brandeis University during the academic year 1965-1966. About half of this 
course was devoted to algebra and topology, while the other half covered 
calculus, with the preliminary edition as the text. It is almost obligatory in 
such circumstances to report that the preliminary version was a gratifying 
success. This is always safe — after all, the class is unlikely to rise up in a body 
and protest publically — but the students themselves, it seems to me, deserve 
the right to assign credit for the thoroughness with which they absorbed 
an impressive amount of mathematics. I am content to hope that some 
other students will be able to use the book to such good purpose, and with 
such enthusiasm. 



Waltham, Massachusetts 
February 1967 



MICHAEL SPIVAK 



PREFACE TO THE 

WORLD STUDENT SERIES EDITION 



In American universities, "calculus" courses are so varied in content and 
viewpoint that only tradition dictates that the same title be given to all. Some 
of these courses cover only the most rudimentary techniques, sedulously shun- 
ning all theory. At the other extreme, so-called "honors" courses concentrate 
on the foundations, and emphasize the theoretical importance of the basic 
processes of calculus, which have often already been seen by the students in 
their high school classes. This book was written for just such courses. In the 
United States, they are so rare that I felt constrained to begin my original 
preface with a lengthy defense, or apology for the fact that it was really written 
for the very type of course which in Great Britain and Europe is quite standard, 
and usually called "An introduction to Real analysis". From that long prologue 
I would like to salvage only one thought, and once again express my feeling 
that the foundations of analysis provide one of the most beautiful instances of 
the welding together of mathematical intuition and mathematical rigor, and 
that ignoring either one only weakens, rather than strengthens, the other. 

A few comments about the contents and arrangement should be made, 
especially for the student who is learning the material on his own. Of the twenty- 
nine chapters in the book, two (starred) chapters are "optional", and the three 
chapters comprising Part V might be thought of in the same way. Moreover, 
the appendices to Chapters 3 and 1 1 also contain "optional" material. Aside 
from this, the order of the remaining chapters is intentionally quite inflexible, 
since the purpose of the book is to present calculus as the evolution of one idea, 
not as a collection of "topics". Since the most exciting concepts of calculus 
do not appear until Part III, I should point out that Parts I and II will probably 
require less time than their length suggests, and although the entire book 
covers a one-year course, the chapters are not meant to be covered at any 
uniform rate. A rather natural dividing point does occur between Parts II and 
III, so it is possible to reach differentiation and integration even more quickly by 
reading Part II very briefly, perhaps returning later for more detailed study. But 
I personally feel that the route set forth here, though it requires perseverance 
at the beginning, will be the most rewarding. 

The problems, without which any mathematics text is incomplete, range from 
straightforward (but not overly simple) exercises which develop basic tech- 
niques and test understanding of concepts, to problems of considerable dif- 
ficulty and, I hope, of comparable interest. There are about 625 problems in all. 
Those which emphasize manipulations usually contain many examples, 
numbered with small Roman numerals, while small letters are used to label 
interrelated parts in other problems. Some indication of relative difficulty is 
provided by a system of starring and double starring, but there are so many 
criteria forjudging difficulty, and so many hints have been provided, especially 
for harder problems, that this guide is not completely reliable. Many problems 
are so difficult, especially if the hints are not consulted, that the best of students 
will probably have to attempt only those which especially interest them. From 
the less difficult problems it should be easy to select a portion which will be 
ix 
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challenging, but not frustrating. The Answer Section contains solutions to 
about half the examples from an assortment of problems that should provide a 
good test of technical competence. A separate answer book, Supplement to 
Calculus, contains the solutions of the other parts of these problems, and of all 
the other problems as well. Finally, there is a Suggested Reading list, to which 
the problems often refer, and a Glossary of Symbols. 

Once again I will take the opportunity to mention the many people to whom 
I owe my thanks. Mrs. Jane Bjorkgren performed prodigious feats of typing 
that compensated for my fitful production of the manuscript. Mr. Richard 
Serkey helped collect the material which provided historical sidelights in the 
problems, and Mr. Richard Weiss supplied the answers appearing in the back 
of the book. I am especially grateful to my friends Michael Freeman, Jay 
Goldman, Anthony Phillips, and Robert Wells for the care with which they 
read, and the relentlessness with which they criticized, a preliminary version 
of the book. 

The inadequacies which preliminary editions always involve were gallantly 
endured by a rugged group of freshmen in the honors mathematics course at 
Brandeis University during the academic year 1965-1966. It is almost obli- 
gatory in such circumstances to report that the preliminary version was a 
gratifying success. This is always safe— after all, the class is unlikely to rise up 
in a body and protest publicly — but the students themselves, it seerns to me, 
deserve the right to assign credit for the thoroughness with which they absorbed 
an impressive amount of mathematics. I am content to hope that some other 
students will be able to use the book to such good purpose, and with such 
enthusiasm. 



Berkeley, California 



MICHAEL SPIVAK 



CONTENTS 



PART I Prologue 

1 Basic Properties of Numbers 3 

2 Numbers of Various Sorts 21 



PART II Foundations 

3 Functions 37 
Appendix. Ordered Pairs 52 

4 Graphs 54 

5 Limits 72 

6 Continuous Functions 93 

7 Three Hard Theorems 100 

8 Least Upper Bounds 1 1 1 



PART III Derivatives and Integrals 

9 Derivatives 125 

10 Differentiation 144 

11 Significance of the Derivative 163 
Appendix. Convexity and Concavity 191 

12 Inverse Functions 200 

13 Integrals 214 

14 The Fundamental Theorem of Calculus 240 

15 The Trigonometric Functions 256 
*16 7r is Irrational 277 

17 The Logarithm and Exponential Functions 283 

18 Integration in Elementary Terms 302 



PART IV Infinite Sequences and Infinite Series 

19 Approximation by Polynomial Functions 333 

*20 e is Transcendental 362 

21 Infinite Sequences 372 

22 Infinite Series 388 

23 Uniform Convergence and Power Series 412 

24 Complex Numbers 433 

25 Complex Functions 448 

26 Complex Power Series 462 

xi 



xii Contents 



PART V Epilogue 

27 Fields 487 

28 Construction of the Real Numbers 494 

29 Uniqueness of the Real Numbers 507 

Suggested Reading 513 
Answers {to selected problems) 523 
Glossary of Symbols 571 
Index 575 




PART 
PROLOGUE 



To be conscious that 
you are ignorant is a great step 
to knowledge. 

BENJAMIN DISRAELI 



I 



CHAPTER I BASIC PROPERTIES OF NUMBERS 



The title of this chapter expresses in a few words the mathematical knowledge 
required to read this book. In fact, this short chapter is simply an explanation 
of what is meant by the "basic properties of numbers/' all of which — addition 
and multiplication, subtraction and division, solutions of equations and 
inequalities, factoring and other algebraic manipulations— are already 
familiar to us. Nevertheless, this chapter is not a review. Despite the familiarity 
of the subject, the survey we are about to undertake will probably seem quite 
novel; it does not aim to present an extended review of old material, but to 
condense this knowledge into a few simple and obvious properties of numbers. 
Some may even seem too obvious to mention, but a surprising number of 
diverse and important facts turn out to be consequences of the ones we shall 
emphasize. 

Of the twelve properties which we shall study in this chapter, the first nine 
are concerned with the fundamental operations of addition and multiplica- 
tion. For the moment we consider only addition: this operation is performed 
on a pair of numbers — the sum a + b exists for any two given numbers a and b 
(which may possibly be the same number, of course). It might seem reason- 
able to regard addition as an operation which can be performed on several 
numbers at once, and consider the sum a\ + • • ■ + a n of n numbers 
a u • • • , a% as a basic concept. It is more convenient, however, to consider 
addition of pairs of numbers only, and to define other sums in terms of sums 
of this type. For the sum of three numbers a, b, and c, this may be done in two- 
different ways. One can first add b and c, obtaining b + c, and then add a to 
this number, obtaining a + (b + c); or one can first add a and b, and then 
add the sum a + b to c, obtaining (a + b) + c. Of course, the two compound 
sums obtained are equal, and this fact is the very first property we shall list: 

(PI) If «, b, and c are any numbers, then 

a + (b + c) = (a + b) + c. 

The statement of this property clearly renders a separate concept of the sum 
of three numbers superfluous; we simply agree that a + b + c denotes the 
number a + (b + c) } = (a + b) + c. Addition of four numbers requires 
similar, though slightly more involved, considerations. The symbol a + b + 
c + d is defined to mean 

(1) ((a + b)+c)+d, 
or (2) (a + (b + e)) + d 9 
or (3) a + {(b + c) + d), 
or (4) a + (b + (c + d)), 
or (5) (a + b) + (c + d). 



3 



This definition is unambiguous since these numbers are all equal. Fortunately, 
this fact need not be listed separately, since it follows from the property PI 
already listed. For example, we know from PI that 

(a + b) + c = a + (b + c), 

and it follows immediately that (1) and (2) are equal. The equality of (2) and 
(3) is a direct consequence of PI, although this may not be apparent at first 
sight (one must let b + c play the role of b in PI, and d the role of c). The 
equalities (3) = (4) = (5) are also simple to prove. 

It is probably obvious that an appeal to PI will also suffice to prove the 
equality of the 14 possible ways of summing five numbers, but it may not be so 
clear how we can reasonably arrange a proof that this is so without actually 
listing these 14 sums. Such a procedure is feasible, but would soon cease to be 
if we considered collections of six, seven, or more numbers; it would be totally 
inadequate to prove the equality of all possible sums of an arbitrary finite 
collection of numbers ai, . . . , a n . This fact may be taken for granted, but 
for those who would like to worry about the proof (and it is worth worrying 
about once) a reasonable approach is outlined in Problem 23. Henceforth, we 
shall usually make a tacit appeal to the results of this problem and write sums 
a x + ■ • • + a n with a blithe disregard for the arrangement of parentheses. 

The number 0 has one property so important that we list it next: 

(P2) If a is any number, then 

a + 0 = 0 + a = a. 

An important role is also played by 0 in the third property of our list: 

(P3) For every number a, there is a number —a such that 

a+ (-a) = (- fl ) +a = 0. 

Property P2 ought to represent a distinguishing characteristic of the number 
0, and it is comforting to note that we are already in a position to prove 
this. Indeed, if a number x satisfies 

a + x = a 

for any one number a, then x = 0 (and consequently this equation also holds 
for all numbers a). The proof of this assertion involves nothing more than 
subtracting a from both sides of the equation, in other words, adding — a to 
both sides; as the following detailed proof shows, all three properties P1-P3 
must be used to justify this operation. 

If a + x = <z, 

then (—a) + (a + x) = {—a) + a = 0; 

hence (( — a) + a) + x = 0; 

hence 0 + # = 0; 

hence x = 0. 
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As we have just hinted, it is convenient to regard subtraction as an operation 
derived from addition: we consider a — b to be an abbreviation for a + ( — b). 
It is then possible to find the solution of certain simple equations by a series 
of steps (each justified by PI, P2, orP3) similar to the ones just presented for 
the equation a + x = a. For example: 

If x + 3 = 5, 

then (* + 3) + (-3) = 5 + (-3); 

hence x + (3 + (-3)) = 5-3 = 2: 
hence x + 0 = 2; 

hence x — 2. 

Naturally, such elaborate solutions are of interest only until you become con- 
vinced that they can always be supplied. In practice, it is usually just a waste 
of time to solve an equation by indicating so explicitly the reliance on proper- 
ties PI, P2, and P3 (or any of the further properties we shall list). 

Only one other property of addition remains to be listed. When considering 
the sums of three numbers a, b, and c, only two sums were mentioned: (a + b) 
+ c and a + (b + c). Actually, several other arrangements are obtained if 
the order of a, b, and c is changed. That these sums are all equal depends on 

(P4) If a and b are any numbers, then 

a + b — b + a. 

The statement of P4 is meant to emphasize that although the operation of 
addition of pairs of numbers might conceivably depend on the order of the 
two numbers, in fact it does not. It is helpful to remember that not all opera- 
tions are so well behaved. For example, subtraction does not have this prop- 
erty: usually a — b 9± b — a. In passing we might ask just when a — b does 
equal b — a, and it is amusing to discover how powerless we are if we rely 
only on properties P1-P4 to justify our manipulations. Algebra of the most 
elementary variety shows that a — b — b — a only when a = b. Nevertheless, 
it is impossible to derive this fact from properties P1-P4; it is instructive to 
examine the elementary algebra carefully and determine which step(s) 
cannot be justified by P1-P4. We will indeed be able to justify all steps in 
detail when a few more properties are listed. Oddly enough, however, the 
crucial property involves multiplication. 

The basic properties of multiplication are fortunately so similar to those for 
addition that little comment will be needed; both the meaning and the conse- 
quences should be clear. (As in elementary algebra, the product of a and b 
will be denoted by a * b> or simply ab.) 

(P5) If a, b } and c are any numbers, then 

a ' (b ' c) = (a - b) ' c. 

(P6) If a is any number, then 



a ' 1 = 1 • a = a. 



Moreover, 1^0. 



(The assertion that 1^0 may seem a strange fact to list, but we have to 
list it, because there is'no way it could possibly be proved on the basis of 
the other properties listed — these properties would all hold if there were 
only one number, namely, 0.) 

(P7) For every number a =^ 0, there is a number a~ l such that 

a * a~ l — a~ l • a = 1. 
(P8) If a and b are any numbers, then 

a ' b = b ' a. 

One detail which deserves emphasis is the appearance of the condition 
a 7* 0 in P7. This condition is quite necessary; since 0 • b = 0 for all numbers 
b, there is no number CP 1 satisfying 0 • 0 -1 = 1. This restriction has an impor- 
tant consequence for division. Just as subtraction was defined in terms of 
addition, so division is defined in terms of multiplication: the symbol a/b 
means a * b~~ l . Since CT" 1 is meaningless, a/0 is also meaningless — division by 0 
is always undefined. 

Property P7 has two important consequences. If a • b = a * c, it does not 
necessarily follow that b = c; for if a — 0, then both a ■ b and a ' c are 0, no 
matter what b and c are. However, if a ^ 0, then b — c; this can be deduced 
from P7 as follows: 

If a • b — a * c and a 0, 

then a~~ l • (a • b) = a~ x * (a ' c)\ 
hence (a~ l • a) * b — (a~ l • a) • c; 
hence 1 • b = 1 * c; 

hence b = c. 

It is also a consequence of P7 that if a • b = 0, then either a = 0 or £ = 0. 
In fact, 

if a ' 6 ~ 0 and a ?± 0, 

then a -1 • (a • 6) = 0; 

hence (a~ l * a) • b — 0; 
hence 1-^ = 0; 

hence /; = 0. 

(It may happen that a = 0 and 6 = 0 are both true; this possibility is not 
excluded when we say "either a = 0 or b = 0"; in mathematics "or" is 
always used in the sense of "one or the other, or both.") 

This latter consequence of P7 is constantly used in the solution of equations. 
Suppose, for example, that a number x is known to satisfy 

(* ~ 1)(* - 2) - 0. 

Then it follows that either x — 1 = 0 or x — 2 ~ 0; hence x — 1 or x = 2. 
On the basis of the eight properties listed so far it is still possible to prove 
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very little. Listing the next property, which combines the operations of addi- 
tion and multiplication, will alter this situation drastically. 

(P9) If a, b, and c are any numbers, then 

a • (b + c) = a ' b + a • c. 

(Notice that the equation (b + c) ■ a = b • a + c • a is also true, by P8.) 

As an example of the usefulness of P9 we will now determine just when a - b 



— b — a: 

If a — b — b — a, 

then (a - b) + b = (b - a) + b = b + (b - a); 

hence a = b + b — a; 

hence a + a = {b + b - a) + a = b + b. 

Consequently a ■ (1 + 1) = £ * (1 + 1), 

and therefore a — b. 



A second use of P9 is the justification of the assertion a ■ 0 = 0 which we have 
already made, and even used in a proof on page 6 (can you find where?). 
This fact was not listed as one of the basic properties, even though no proof 
was offered when it was first mentioned. With P1-P8 alone a proof was not 
possible, since the number 0 appears only in P2 and P3, which concern addi- 
tion, while the assertion in question involves multiplication. With P9 the 
proof is simple, though perhaps not obvious: We have 

a ' 0 + a ' 0 = a ' (0 + 0) 
= a • 0; 

as we have already noted, this immediately implies (by adding (a • 0) to 
both sides) that d ■ 0 = 0. 

A series of further consequences of P9 may help explain the somewhat 
mysterious rule that the product of two negative numbers is positive. To begin 
with, we will establish the more easily acceptable assertion that ( — a) • b = 

— (a ' b). To prove this, note that 

(-a) 'b + a'b = [(-a) +a]'b 
= 0-b 
= 0. 

It follows immediately (by adding - (a • b) to both sides) that (-a) • * = 

— (a-b). Now note that 

(-*) • (-&) + [-(a * &)] = (-a) • (-/>) + (-a) • b 

= (-«)•[(-*) + *] 
= (-tf)'O 
= 0. 

Consequently, adding (a • 6) to both sides, we obtain 



The fact that the product of two negative numbers is positive is thus a conse- 
quence of P1-P9. In other words, if we want PI to P9 to be true, the rule for the 
product of two negative numbers is forced upon us. 

The various consequences of P9 examined so far, although interesting and 
important, do not really indicate the significance of P9; after all we could have 
listed each of these properties separately. Actually, P9 is the justification for 
almost all algebraic manipulations. For example, although we have shown 
how to solve the equation 

(x - l)(x - 2) = 0, 

we can hardly expect to be presented with an equation in this form. We are 
more likely to be confronted with the equation 

x 2 - 3x + 2 = 0. 

The "factorization" x 2 - 2>x + 2 = (x - 1)(* - 2) is really a triple use 
ofP9: 

(* - 1) • (* - 2) = x • (* - 2) + (-1) • (* - 2) 

= x • x + x • (-2) + (-1) • x + (-1) • (-2) 
= x 2 + x[(-2) + (-l)] + 2 
= x 2 - 3x + 2. 

A final illustration of the importance of P9 is the fact that this property is 
actually used every time one multiplies arabic numerals. For example, the 
calculation 

13 
X24 
52 
26 
312 

is a concise arrangement for the following equations: 

13 • 24 = 13 • (2 • 10 + 4) 

= 13 -2 • 10 + 13 • 4 
= 26 • 10 + 52. 

(Note that moving 26 to the left in the above calculation is the same as writing 
26 • 10.) The multiplication 13 • 4 = 52 uses P9 also: 

13-4 = (1 • 10 + 3) -4 
= 1 • 10 • 4 + 3 • 4 
-4-10 + 12 
= 4-10 + 1-10 + 2 
= (4 + 1) • 10 + 2 
= 5-10 + 2 
= 52. 
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The properties P1-P9 have descriptive names which are not essential to 
remember, but which are often convenient for reference. We will take this 
opportunity to list properties P1-P9 together and indicate the names by 
which they are commonly designated. 



(PI) (Associative law for addition) 
(P2) (Existence of an additive 
identity) 

(P3) (Existence of additive inverses) 
(P4) (Commutative law for addition) 
(P5) (Associative law for multiplica- 
tion) 

(P6) (Existence of a multiplicative 
identity) 

(P7) (Existence of multiplicative 
inverses) 

(P8) (Commutative law for multi- 
plication) 
(P9) (Distributive law) 



a + (b + c) = {a + b) + c. 
a + 0 = 0 + a = a. 

a + (-a) = (-a) + a = 0. 

a + b = b + a. 

a - (b • c) = (a ' b) ' c. 

a - 1 = 1 ■ a = a; 1^0. 

a * <T l = d~ l ' a = 1, tor a 0. 

a * b = b ' a. 

a • (b + c) — a • b + a • c. 



The three basic properties of numbers which remain to be listed are con- 
cerned with inequalities. Although inequalities occur rarely in elementary 
mathematics, they play a prominent role in calculus. The two notions of 
inequality, a < b (a is less than b) and a > b (a is greater than b), are intimately 
related: a < b means the same as b > a (thus 1 < 3 and 3 > 1 are merely two 
ways of writing the same assertion). The numbers a satisfying a > 0 are 
called positive, while those numbers a satisfying a < 0 are called negative. 
While positivity can thus be defined in terms of <, it is possible to reverse 
the procedure: a < b can be defined to mean that b — a is positive. In fact, 
it is convenient to consider the collection of all positive numbers, denoted by 
P 9 as the basic concept, and state all properties in terms of P: 



(P10) (Trichotomy law) For every number a, one and only one of the 
following holds: 

(i) a = 0, 

(ii) a is in the collection P, 

(iii) — a is in the collection P. 

(PI 1) (Closure under addition) If a and b are in P, then a + b is in P. 
(PI 2) (Closure under multiplication) If a and b are in P, then a ■ b is 
in P. 



These three properties should be complemented with the following defini- 
tions: 

a > b if a — • b is in P; 
a < b if b > a; 
a > b if a > b or a = b\ 
a < b if a < b or a = b* 

Note, in particular, that a > 0 if and only if a is in P. 

All the familiar facts about inequalities, however elementary they may 
seem, are consequences of P10-P12. For example, if a and b are any two 
numbers, then precisely one of the following holds: 

(i) a - b = 0, 

(ii) a — b is in the collection P, 

(iii) — (a — b) = b — a is in the collection P. 

Using the definitions just made, it follows that precisely one of the following 
holds: 

(i) a = b, 

(ii) a > b, 

(iii) b > a. 

A slightly more interesting fact results from the following manipulations. 
If a < b, so that b — a is in P, then surely (b + c) — {a + <0 is in P; thus, if 
a < b, then a + c < £ + c. Similarly, suppose a < b and b < c. Then 

b — a is in P, 
and c — b is in P, 

so c — a — (c — b) + (b — a) is in P. 

This shows that if a < b and b < c, then a < c. (The two inequalities a < b 
and £ < c are usually written in the abbreviated form a < b < c, which has 
the third inequality a < c almost built in.) 

The following assertion is somewhat less obvious: If a < 0 and b < 0, then 
ab > 0. The only difficulty presented by the proof is the unraveling of defini- 
tions. The symbol a < 0 means, by definition, 0 > a, which means 0 — a — 
— a is in P. Similarly — b is in P, and consequently, by PI 2, (—a)( — b) — ab 
is in P. Thus ab > 0. 

The fact that ab > 0 if a > 0, b > 0 and also if a < 0, b < 0 has one 
special consequence: a 2 > 0 if a ^ 0. Thus squares of nonzer> numbers are 

* There is one slightly perplexing feature of the symbols > and < . The statements 

1 + 1 < 3 
1 + 1 < 2 

are both true, even though we know that < could be replaced by < in the first, and by = 
in the second. This sort of thing is bound to occur when < is used with specific numbers; the 
usefulness of the symbol is revealed by a statement like Theorem 1 — here equality holds for 
some values of a and b, while inequality holds for other values. 
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always positive, and in particular we have proved a result which might have 
seemed sufficiently elementary to be included in our list of properties: 1 > 0 
(since 1 = l 2 ). 

The fact that -a > 0 if a < 0 is the basis of a concept which will play an 
extremely important role in this book. For any number a, we define the 
absolute value \a\ of a as follows: 



III a, a > 0 
~ \ -a, a < 0. 



\a + b 


! < \a\ 


+ 1*1- 


0) 


a 


>o, 


b > 0; 


(2) 


a 


>o, 


b < 0; 


(3) 


a 


< o, 


b > 0; 


(4) 


a 


<o, 


b < 0. 



Note that \a\ is always positive, except when a = 0. For example, we have 
| — 3j = 3, |7J = 7, Jl + V2 - = 1 + V2 - V3, and |1 + V2 - 
V 7 !^! = VlO — V2 — 1. In general, the most straightforward approach to 
any problem involving absolute values requires treating several cases sepa- 
rately, since absolute values are defined by cases to begin with. This approach 
may be used to prove the following very important fact about absolute values, 

THEOREM 1 For all numbers a and b, we have 



PROOF We will consider 4 cases: 



In case (1) we also have a + b > 0, and the theorem is obvious; in fact, 

\ a + b\ = a + b - \a\ + \b\, 

so that in this case equality holds. 

In case (4) we have a + b < 0, and again equality holds: 

\a + b\= -(a + b) = -a + (-*) = \a\ + \b\. 

In case (2), when a > 0 and b < 0, we must prove that 

\a + b\ < a - b. 

This case may therefore be divided into two subcases. If a + b > 0, then we 
must prove that 

a + b < a — b, 
i.e., b < -b, 

which is certainly true since b is negative and -b is positive. On the other 
hand, if a + b < 0, we must prove that 

— a — b < a — b, 
i.e., —a < a, 

which is certainly true since a is positive and — a is negative. 



Finally, note that case (3) may be disposed of with no additional work, by 
applying case (2) with a and b interchanged. | 

Although this method of treating absolute values (separate consideration 
of various cases) is sometimes the only approach available, there are often 
simpler methods which may be used. In fact, it is possible to give a much 
shorter proof of Theorem 1 ; this proof is motivated by the observation that 

\a\ = V7 2 . 

(Here, and throughout the book, denotes the positive square root of x; this 
symbol is defined only when x > 0.) We may now observe that 

(\a + b\) 2 = (a + b) 2 - a 2 + lab + b 2 

< a 2 + 2\a\ • \b\ + b 2 
= \a\ 2 + 2\a\ • \b\ + \b\ 2 

= (W + H) 2 . 

From this we can conclude that \a + b\ < \a\ + \b\ because x 2 < y 2 implies 
x < y, provided that x and y are both non-negative; a proof of this fact is left 
to the reader (Problem 5). 

One final observation may be made about the theorem we have just 
proved : a close examination of either proof offered shows that 

\a + b\ = \a\ + \b\ 

if a and b have the same sign (i.e., are both positive or both negative), or if 
one of the two is 0, while 

\a + b\< \a\ + \b\ 

if a and b are of opposite signs. 

We will conclude this chapter with a subtle point, neglected until now, 
whose inclusion is required in a conscientious survey of the properties of 
numbers. After stating property P9, we proved that a — b = b — a implies 
a = b. The proof began by establishing that 

a' (1 + 1) = A - (1 +1), 

from which we concluded that a = b. This result is obtained from the equation 
a • (1 + 1) = b ' (1 + 1) by dividing both sides by 1 + 1. Division by 0 
should be avoided scrupulously, and it must therefore be admitted that the 
validity of the argument depends on knowing that 1 + 1^0. Problem 24 
is designed to convince you that this fact cannot possibly be proved from 
properties P1-P9 alone ! Once P10, Pll, and PI 2 are available, however, the 
proof is very simple: We have already seen that 1 > 0; it follows that 1 + 1 > 
0, and in particular 1 + 1^0. 

This last demonstration has perhaps only strengthened your feeling that it 
is absurd to bother proving such obvious facts, but an honest assessment of our 
present situation will help justify serious consideration of such details. In 



Basic Properties of Numbers 13 



this chapter we have assumed that numbers are familiar objects, and that 
PI -PI 2 are merely explicit statements of obvious, well-known properties of 
numbers. It would be difficult, however, to justify this assumption. Although 
one learns how to "work with" numbers in school, just what numbers are, 
remains rather vague. A great deal of this book is devoted to elucidating the 
concept of numbers, and by the end of the book we will have become quite 
well acquainted with them. But it will be necessary to work with numbers 
throughout the book. It is therefore reasonable to admit frankly that we do 
not yet thoroughly understand numbers; we may still say that, in whatever 
way numbers are finally defined, they should certainly have properties 



Most of this chapter has been an attempt to present convincing evidence 
that PI -PI 2 are indeed basic properties which we should assume in order to 
deduce other familiar properties of numbers. Some of the problems (which 
indicate the derivation of other facts about numbers from PI -PI 2) are offered 
as further evidence. It is still a crucial question whether PI -PI 2 actually 
account for all properties of numbers. As a matter of fact, we shall soon see 
that they do not. In the next chapter the deficiencies of properties PI -PI 2 will 
become quite clear, but the proper means for correcting these deficiencies is 
not so easily discovered. The. crucial additional basic property of numbers 
which we are seeking is profound and subtle, quite unlike PI -PI 2. The dis- 
covery of this crucial property will require all the work of Part II of this book. 
In the remainder of Part I we will begin to see why some additional property 
is required; in order to investigate this we will have to consider a little more 
carefully what we mean by "numbers." 

PROBLEMS 

1. Prove the following: 

(i) If ax = a for some number a ^ 0, then x — 1 . 

(ii) x 2 - y 2 = (x - y){x + y). 

(iii) If x 2 = y 2 , then x = y or x = —y. 

(iv) x 3 — y 3 = (x — y){x 2 + xy + y 2 ). 

(v) x n -y n = (x - y)(x n ' 1 + x n ~ 2 y + • ■ • + xy n ~ 2 + y n ~ l ). 

(vi) x 3 + y z = (x + y)(x 2 — xy + y 2 ). (There is a particularly easy 
way to do this, using (iv), and it will show you how to find a fac- 
torization for x n + y n whenever n is odd.) 

2. What is wrong with the following "proof? Let x = y. Then 



P1-P12. 




xy - y 2 , 
y(x - y), 



(x +y)(x - y) 
x + y 

2 



y> 
l. 
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3. Prove the following: 



a c ad ~\- be 



> if 6, 5* 0. 



(iii) (ab)~ L = a~ l b~ l , if a, b 0. (To do this you must remember the 
defining property of (ab)~~ l .) 



(vi) If b 9 d * 0, then - = - if and only if ad = be. Also determine when 

b d 

a _ b 
b a 

4. Find all numbers x for which 

(i) 4 - x < 3 - 2x. 

(ii) 5 - x 2 < 8. 

(iii) 5 - x 2 < -2. 

(iv) (x — \){x - 3) > 0. (When is a product of two numbers posi- 
tive?) 

(v) x 2 - 2x + 2 > 0. 

(vi) x 2 + x + 1 > 2. 

(vii) * 2 - * + 10 > 16. 

(viii) x 2 + x + 1 > 0. 

(ix) (* - 7r)Cr + 5)(* - 3) > 0. 

(x) (x - \ / 2){x - V2) > 0. 

(xi) 2* < 8. 

(xii) * + 3* < 4. 

1 1 

(xiii) - + > 0. 

x 1 — X 



5. Prove the following: 

(i) If a < b and c < d, then a + c < b + d. 

(ii) If a < b, then -b < -a. 



(iv) 
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(iii) If a < b and c > d, then a — c < b — d. 

(iv) If a < b and e > 0, then ac < be. 

(v) If a < b and c < 0, then ac > be. 

(vi) If a > 1, then a 1 > a. 

(vii) If 0 < a < 1, then f2 2 < a. 

(viii) If 0 < a < b and 0 < c < d, then < bd. 
.(ix) If 0 < a < b, then a 2 < b\ (Use (viii).) 

(x) If a, £ > 0 and a 2 < b 2 , then a < b. (Use (ix), backwards.) 

6. Prove that if 0 < a < b, then 

/ — a + b 
a < Vab < ~^r— < b. 

Notice that the inequality V a6 < (a + £)/2 holds for a, b > 0, without 
the additional assumption a < b. A generalization of this fact occurs in 
Problem 2-20. 

*7. (a) Prove that if x n = y 11 and n is odd, then x = y. Hint: First explain 
why it suffices to consider only the case x, y > 0; then show that 
x < y and y > x are both impossible, 
(b) Prove that if x n = y n and ;? is even, then x = or x = —v. 
*8. Although the basic properties of inequalities were stated in terms of the 
collection P of all positive numbers, and < was defined in terms of P, 
this procedure can be reversed. Suppose that P10-P12 are replaced by 

(P'10) For any numbers a and b one, and only one, of the follow- 
ing holds: 

« a = b, 

(ii) a < b, 

(iii) b < a. 

(P'll) For any numbers a, b, and c, if a < b and b < c, then 
a < e. 

(P'12) For any numbers <2, b, and c, it a < b, then a + c < b + e. 
(P'13) For any numbers a, b, and c, if a < b and 0 < c, then 
ac < be. 

Show that P10-P12 can then be deduced as theorems. 
9. Express each of the following with at least one less pair of absolute value 
signs. 

(i) \V2 + V3 - V 7 5 + 

(ii) \(\a + b\ - |*| - \b\)\. 

(iii) |(|fl + 6| + H ~ \a + b + c\)\. 

(iv) -_2xy +/|. 

(v) |(|V2 + V3|-|V5-V7|)|. 
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10. Express each of the following without absolute value signs, treating 
various cases separately when necessary. 

(i) \a + b\- \b\. 
(ii) 

(iii) |*| - |^|. 

(iv) a - \{a - \a\)\. 

11. Find all numbers * for which 



12. 



(i) 
(ii) 
(iii) 
(iv) 

(v) 
(vi) 
(vii) 

(viii) |* - 1| • |* + 2| = 3. 
Prove the following: 

(i) \xy\ = |*| • \y\. 



|* - 3| = 8. 
I* - 3| < 8. 
|* + 4| < 2. 
|* - lj + |* - 2\ > 1. 
|* - 1| + |* + 1| < 2. 
|* - lj + |*+ lj < 1. 
I* - II- I* + II = 0. 



(ii) 



(iii) 



= — > if x 9* 0. (The best way to do this is to remember what 

\x\ 



- 1 is.) 

X 

y 



if/?* 0. 



Civ) \x — y\ < |#| + | jv I - (Give a very short proof.) 

(v) \x\ — \y\ < \x — y\. (A very short proof is possible, if you write 
things in the right way.) 

(vi) |(|#| — |jy|)| < \x — y\. (Why does this follow immediately from 

(v)?) 

(vii) |* + y + z\ < \x\ + \y\ + \z\. Indicate when equality holds, and 
prove your statement. 

13. The maximum of two numbers x and y is denoted by max(^, j). Thus 
max( — 1, 3) = max (3, 3) = 3 and max( — 1, — 4) = max (—4, —1) 
= — 1. The minimum of x and y is denoted by min(#, y). Prove that 

, N x +y + \y — x\ 



min(*, y) 



= x + y — \y — x\ 



Derive a formula for max(x, y, z) and min(# ? y } z), using, for example, 
max(#, y, z) = max (at, max(jy, z)). 
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14. (a) Prove that \a\ = \ —a\. (The trick is not to become confused by too 
many cases. First prove the statement for a > 0. Why is it then 
obvious for a < 0?) 

(b) Prove that —b<a<b if , and only if \a\ < b. In particular, it 
follows that — \a\ < a < \a\. 

(c) Use this fact to give a new proof that \a + b\ < \a\ + \b\, 

*15. (a) Use Problem 1 and Problem 7 to prove that if x and j are not both 
0, then 

x 1 + xy + y 2 ^ 0, 
x 4 + x z y + x 2 y 2 + xy z + y* 9* 0. 

For every number x 9^ 0, each of these expressions is positive for some 
positive number y and also for some negative y (namely, y — ±x); it 
therefore seems reasonable that the ^ signs can be replaced by > 
signs. This maneuver is valid, but we are not yet in a position to prove 
this (see Problem 7-9). Parts fb) and (d) of this problem provide a 
direct demonstration that the > signs hold. 

(b) Using the fact that 

x 2 + 2xy +y 2 = (* + y) 2 > 0, 

show that the assumption x 2 + xy + y 2 < 0 leads to a contradiction. 

(c) Show similarly that if x and y are not both 0, then 

4x 2 + 6xy + Ay 2 > 0, 
3x 2 + 5xy + 3y 2 > 0. 

**(d) Show that if x and y are not both 0, then 

* 4 + x z y + x 2 y 2 + xy* + > 4 > 0. 

*16. (a) Show that 

(x + y) 2 — x 2 + y 2 only when x — 0 or y = 0, 

(x + y) z = x z + y z only when x = 0or;y = 0or# = —y. 

(b) Use Problem 15 to find out when (x + yY = x* + y\ 

**(c) Find out when (x + yY = ^ 5 + y 5 - Hint: From the assumption 

(x + yY = x b + y h you should be able to derive the equation 

x z + 2x 2 y + 2xy 2 + y z = 0, if xy 0. This implies that (x + yY = 
x 2 y _|_ xy 2 = + y y 

You should now be able to make a good guess as to when (x + y) n = 
x n + y n \ the proof is contained in Problem 11-41. 
17. (a) Suppose that b 2 — Ac > 0. Show that the numbers 

-b + V b 2 - 4c -b - Vb 2 - 4c 
2 ' 2 

both satisfy the equation x 2 + bx + c = 0. 



(b) Suppose that b 2 — Ac < 0. Show that there are no numbers x 
satisfying x 2 + bx + c = 0; in fact, x 2 + bx + c > 0 for all x. Hint: 
"Complete the square," i.e., write x 2 + bx + c = (x + £/2) 2 + ? 

(c) Use this fact to give another proof that if x and jy are not both 0, 
then x 2 + xy + y 2 > 0. 

(d) For which numbers a is it true that x 2 + axy -{- y 2 > 0 whenever 
x and y are not both 0? 

(e) Find the smallest possible value of x 2 + bx + c and of ax 2 + bx + c, 
for a 0. (Use the trick in part (b).) 

18. The fact that a 2 > 0 for all numbers a, elementary as it may seem, is 
nevertheless the fundamental idea upon which most important in- 
equalities are ultimately based. The great-granddaddy of all inequalities 
is the Schwartz inequality: 

xiyi + x 2 y 2 < V*! 2 + x 2 2 V / yi 2 + y 2 2 . 

The three proofs of the Schwartz inequality outlined below have only 
one thing in common — their reliance on the fact that a 2 > 0 for all a. 

(a) Prove the Schwartz inequality by first proving that 

(xi 2 + x 2 2 )(yi 2 +^ 2 2 ) = Oiji + x 2 y 2 ) 2 + Oij 2 — xoji) 2 . 

(b) Prove that if x\ = Xy x and x 2 = X^ 2 for some number X, then 
equality holds in the Schwartz inequality. Prove the same thing if 
yi — V2 = 0. Now suppose that yi and y 2 are not both 0, and that 
there is no number X such that x\ = \y x and x 2 = \y 2 . Then 

o < (x>-i - x x y + (Xv 2 - x 2 y 

= \ 9 (yi 2 +y* 2 ) ~ 2X(x iyi + x 2 y 2 ) + (x, 2 + x 2 2 ). 

Using Problem 17, complete the proof of the Schwartz inequality. 

(c) Prove the Schwartz inequality by using 2xy < x 2 + y 2 (how is this 
derived?) with 

Xi yi 
x = y = ; 

V Xl 2 + X 2 2 Vy x *+y t * 

first for i — 1 and then for z — 2. 

(d) Deduce, from each of these three proofs, that equality holds only 
when yi = y 2 = 0 or when there is a number X such that Xi — Xyi 
and x 2 = Xy 2 . 

In our later work, three facts about inequalities will be crucial. Although 
proofs will be supplied at the appropriate point in the text, a personal assault 
on these problems is infinitely more enlightening than a perusal of a com- 
pletely worked-out proof. The statements of these propositions involve some 
weird numbers, but their basic message is very simple: if x is close enough to x Q , 
and y is close enough to y Q , then x + y will be close to * 0 + ^o, and xy will be 
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close to x 0 y 0 , and 1 /y will be close to l/y 0 . The symbol "e" which appears in 
these propositions is the fifth letter of the Greek alphabet ("epsilon"), and 
could just as well be replaced by a less intimidating Roman letter; however, 
tradition has made the use of £ almost sacrosanct in the contexts to which 
these theorems apply. 

19. Prove that if 

\x - Xo\ < - and \y - y 0 \ < -> 

then 

\(x +y) - (x 0 +y 0 )\ < e, 
\(x - y) - (x 0 -y 0 )\ < 6. 

*20. Prove that if 

\x - *o|'< min ^_i^y l) and \y - ,„| < 
then \xy — * 0 .)'o| < S. 

(The notation "min" was defined in Problem 13, but the formula pro- 
vided by that problem is irrelevant at the moment; the first inequality 
in the hypothesis just means that 

e 

\x - x 0 \ < —r~ ' , - and \x - x 0 \ < 1 ; 

at one point in the argument you will need the first inequality, and at 
another point you will need the second. One more word of advice: since 
the hypotheses only provide information about x — x 0 and y — y 0 , it is 
almost a foregone conclusion that the proof will depend upon writing 
xy — x 0 yo in a way that involves x — x 0 and y — y 0 .) 
*21. Prove that if y 0 0 and 

, / • f\yo\ z\yo\ 2 \ 

!JV — JVo| <mm^— , — — j> 

then y 0 and 

1 1 | 
I < e. 

y yo i 

*22. Replace the question marks in the following statement by expressions 
involving s, # 0 , and y 0 so that, the conclusion will be true: 

If y Q ^ 0 and 

\y — Vol < ? and \x — x Q \ < ? 



then y 9^ 0 and 

| X Xq 

\y y<> 



< e. 



This problem is trivial in the sense that its solution follows from Problems 
20 and 21 with almost no work at all (notice that x/y = x • \/y). The 
crucial point is not to become confused; decide which of the two 
problems should be used first, and don't panic if your answer looks 
unlikely. 

This problem shows that the actual placement of parentheses in a sum 
is irrelevant. The proofs involve "mathematical induction"; if you are 
not familiar with such proofs, but still want to tackle this problem, it can 
be saved until after Chapter 2, where proofs by induction are explained. 
Let us agree, for definiteness, that a x + ■ • • + a n will denote 

ai + (a 2 + + ' * ' + (a n _ 2 + (a n _ x + a n ))) ■ ■ ■ ). 

Thus ai + a 2 + a z denotes a x + (a 2 + a 3 ), and a x + a 2 + a 3 + a 4 
denotes + (a 2 + (a 3 + # 4 )), etc. 

(a) Prove that 

(ai + ' • • + a k ) + a k+i = ai + • ■ * + a k + x . 

Hint: Use induction on k. 

(b) Prove that if n > fc 3 then 

(ai + • • • + a k ) + (a k+1 + ' ' • + a n ) = ai + ■ • * + a n . 

Hint: Use part (a) to give a proof by induction on k. 

(c) Let s(a h . . . , a k ) be some sum formed from ai, . . . , a k . Show 
that 

s(a h . . . , a k ) = + • • • + a k . 

Hint: There must be two sums s'(a h . . . , a t ) and s ff {a i+h . . . , a k ) 
such that 

s(a u . . . , a k ) = s'(a u . . . , ai) + s"(ai+ h . . . , a*). 

Suppose that we interpret "number" to mean either 0 or 1, and + 
and • to be the operations defined by the following two tables. 



+ 


0 


1 




0 


1 


0 


0 


1 


0 


0 


0 


1 


1 


0 


1 


0 


1 



Check that properties P1-P9 all hold, even though 1 + 1=0. 
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In Chapter 1 we used the word "number" very loosely, despite our concern 
with the basic properties of numbers. It will now be necessary to distinguish 
carefully various kinds of numbers. 
The simplest numbers are the " counting numbers" 

1, 2, 3, ... . 

The fundamental significance of this collection of numbers is emphasized by 
its symbol N (for natural numbers). A brief glance at PI -PI 2 will show that 
our basic properties of "numbers" do not apply to N — for example, P2 and 
P3 do not make sense for N. From this point of view the system N has many 
deficiencies. Nevertheless, N is sufficiently important to deserve several com- 
ments before we consider larger collections of numbers. 

The most basic property of N is the principle of "mathematical induction." 
Suppose P(x) means that the property P holds for the number x. Then the 
principle of mathematical induction states that P(x) is true for all natural 
numbers x provided that 

(1) P(l) is true. 

(2) Whenever P(k) is true, P(h + 1) is true. 

Note that condition (2) merely asserts the truth of P{k + 1) under the 
assumption that P(k) is true; this suffices to ensure the truth of P(x) for all x, 
if condition (1) also holds. In fact, if P(\) is true, then it follows that P(2) is 
true (by using (2) in the special case k = 1). Now, since P(2) is true it follows 
that P(3) is true (using (2) in the special case k = 2). It is clear that each 
number will eventually be reached by a series of steps of this sort, so that 
P(k) is true for all numbers k. 

A favorite illustration of the reasoning behind mathematical induction 
envisions an infinite line of people, 

person number 1, person number 2, person number 3, . . . . 

If each person has been instructed to tell any secret he hears to the person 
behind him (the one with the next largest number) and a secret is told to 
person number 1, then clearly every person will eventually learn the secret. 
If P(x) is the assertion that person number x will learn the secret, then the 
instructions given (to tell all secrets learned to the next person) assures that 
condition (2) is true, and telling the secret to person number 1 makes (1) true. 
The following example is a less facetious use of mathematical induction. 
There is a useful and striking formula which expresses the sum of the first n 
numbers in a simple f way: 
21 
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n(n + 1) 

1+ • • • +„ = __-■ 

To prove this formula, note first that it is clearly true for n = 1. Now assume 
that for some integer k we have 

2 

Then 

k(k + !) + * + 1 

= + 1) +2£ + 2 
2 

= * 2 + 3£ + 2 
2 

(A + !)(* + 2) 



so the formula is also true for k + 1 . By the principle of induction this proves 
the formula for all natural numbers n. This particular example illustrates a 
phenomenon that frequently occurs, especially in connection with formulas 
like the one just proved. Although the proof by induction is often quite 
straightforward, the method by which the formula was discovered remains a 
mystery. Problems 4 and 5 indicate how some formulas of this type may be 
derived. 

The principle of mathematical induction may be formulated in an equiv- 
alent way without speaking of "properties" of a number, a term which is 
sufficiently vague to be eschewed in a mathematical discussion. A more precise 
formulation states that if A is any collection (or "set"— a synonymous mathe- 
matical term) of natural numbers and 

(1) 1 is in A, 

(2) k + 1 is in A whenever h is in A, 

then A is the set of all natural numbers. It should be clear that this formulation 
adequately replaces the less formal one given previously— we just consider the 
set A of natural numbers x which satisfy P(x). For example, suppose A is the 
set of natural numbers n for which it is true that 

n(n + 1) 

1+ • • • + „ = _ 

Our previous proof of this formula showed that A contains 1 , and that k + 1 
is in A, if h is. It follows that A is the set of all natural numbers, i.e., that the 
formula holds for all natural numbers n. 

There is yet another rigorous formulation of the principle of mathematical 
induction, which looks quite different. If A is any collection of natural num- 
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bers, it is tempting to say that A must have a smallest member. Actually, this 
statement can fail to be true in a rather subtle way. A particularly important 
set of natural numbers is the collection A that contains no natural numbers at 
all, the "empty collection" or "null set,"* denoted by 0. The null set 0 is a 
collection of natural numbers that has no smallest member — in fact, it has no 
members at all. This is the only possible exception, however; if A is a nonnull 
set of natural numbers, then A has a least member. This "intuitively obvious" 
statement, known as the "well-ordering principle." can be proved from the 
principle of induction as follows. Suppose that the set A has no least member. 
Let B be the set of natural numbers n such that 1, . . . , n are all not in A. 
Clearly 1 is in B (because if 1 were in A, then A would have 1 as smallest 
member). Moreover, if 1, . . . , k are not in A, surely k + 1 is not in A 
(otherwise k + 1 would be the smallest member of A), so 1, . . . , k + 1 are 
all not in A. This shows that if k is in B, then k + 1 is in B. It follows that 
every number n is in B, i.e., the numbers 1, . . . , n are not in A for any 
natural number n. Thus ^4 = 0, which completes the proof. 

It is also possible to prove the principle of induction from the well-ordering 
principle (Problem 9). Either principle may be considered as a basic assump- 
tion about the natural numbers. 

There is still another form of induction which should be mentioned. It 
sometimes happens that in order to prove P(k + 1) we must assume not only 
P(k), but also P(l) for all natural numbers / < k. In this case we rely on the 
"principle of complete induction": If A is a set of natural numbers and 

(1) 1 is in A, 

(2) k + 1 is in A if 1, . . . , k are in A, 

then A is the set of all natural numbers. 

Although the principle of complete induction may appear much stronger 
than the ordinary principle of induction, it is actually a consequence of that 
principle. The proof of this fact is left to the reader, with a hint (Problem 10). 
Applications will be found in Problems 6, 16, 19, and 20. 

Closely related to proofs by induction are "recursive definitions." For 
example, the number n ! (read "w factorial") is defined as the product of all the 
natural numbers less than or equal to n: 

n\ = 1 • 2 • . . . • {n - 1) - a. 

This can be expressed more precisely as follows: 

(1) 1! = 1, 

(2) n\ = n - (h - 1)!. 

This form of the definition exhibits the relationship between nl and (n — 1) ! 

* Although it may not strike you as a collection, in the ordinary sense of the word, the null set 
arises quite naturally in many contexts. We frequently consider the set A, consisting of all x 
satisfying Isome property P; often we have no guarantee that P is satisfied by any number, so 
that A might be 0— in fact often one proves that P is always false by showing that A — 0. 



in an explicit way that is ideally suited for proofs by induction. Problem 21 
reviews a definition already familiar to you, which may be expressed more 
succinctly as a recursive definition; as this problem shows, the recursive 
definition is really necessary for a rigorous proof of some of the basic properties 
of the definition. 

One definition which may not be familiar involves some convenient nota- 
tion which we will constantly be using. Instead of writing 

a\ + • • • + a n , 

we will usually employ the Greek letter 2 (capital sigma, for "sum") and 
write 

71 

11 

In other words, ^ a { denotes the sum of the numbers obtained by letting 

i = i 

/=1,2, . . . , n. Thus 

n(n + 1) 



1 +2+ • ■ • +n = 



2 

Notice that the letter i really has nothing to do with the number denoted by 

n 

^ i, and can be replaced by any convenient symbol (except n, of course!): 
i=i 

n(n + 1) 



3 = 1 



Hi + 1) 



3 = 1 

V = Hi + V 
L n ~ 2 

n = 1 



To define ^ a { precisely really requires a recursive definition : 

(1) ^ a i = °1> 

n n — 1 

(2) ^ ai = ^ ai + a n . 



But only purveyors of mathematical austerity would insist too strongly on 
such precision. In practice, all sorts of modifications of this symbolism are 
used, and no one ever considers it necessary to add any words of explanation. 
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The symbol 

t 

for example, is an obvious way of writing 

a\ + a 2 + a z + a b + # 6 + * * ' + a n , 

or more precisely, 

3 n 
i = 1 i = 5 

The deficiencies of the natural numbers which we discovered at the begin- 
ning of this chapter may be partially remedied by extending this system to the 
set of integers 

. . . , -2, -1, 0, 1, 2, ... . 

This set is denoted by Z (from German "Zahl," number). Of properties 
PI -PI 2, only P7 fails for Z. 

A still larger system of numbers is obtained by taking quotients m/n of 
integers (with n ^ 0). These numbers are called rational numbers, and the 
set of all rational numbers is denoted by Q (for "quotients''). In this system of 
numbers all of PI -PI 2 are true. It is tempting to conclude that the "properties 
of numbers," which we studied in some detail in Chapter 1, refer to just one 
set of numbers, namely, Q. There is, however, a still larger collection of 
numbers to which properties PI -PI 2 apply — the set of all real numbers, 
denoted by R. The real numbers include not only the rational numbers, but 
other numbers as well (the irrational numbers) which can be represented 
by infinite decimals; w and V2 are both examples of irrational numbers. The 
proof that tt is irrational is not easy — we shall devote all of Chapter 16 of 
Part III to a proof of this fact. The irrationality of V2, on the other hand, is 
quite simple, and was known to the Greeks. (Since the Pythagorean theorem 
shows that an isosceles right triangle, with sides of length 1 , has a hypotenuse 
of length , it is not surprising that the Greeks should have investigated this 
question.) The proof depends on a few observations about the natural num- 
bers. Every natural number n can be written either in the form 2k for some 
integer k, or else in the form 2k + 1 for some integer k (this "obvious" fact has 
a simple proof by induction (Problem 7)). Those natural numbers of the form 
2k are called even; those of the form 2k + 1 are called odd. Note that even 
numbers have even squares, and odd numbers have odd squares: 

(2k) 2 = 4k 2 = 2 • (2k 2 ), 
(2k + l) 2 - 4k 2 + 4k + 1 = 2 • (2k 2 + 2k) + 1. 

In particular it follows that the converse must also hold: if n 2 is even, then n is 
even; if n 2 is odd, then n is odd. The proof that is irrational is now quite 




simple. Suppose that V 2 were rational; that is, suppose there were natural 
numbers p and q such that 



^ = 2. 



We can assume that p and ? have no common divisor (since all common 
divisors could be divided out to begin with). Now we have 

P 2 = 2q\ 

This shows that p 2 is even, and consequently p must be even; that is, p = 2k 
for some natural number k. Then 

so 

2k 2 = q 2 . 

This shows that q 2 is even, and consequently that q is even. Thus both/? and q 
are even, contradicting the fact that p and q have no common divisor. This 
contradiction completes the proof. 

It is important to understand precisely what this proof shows. We have 
demonstrated that there is no rational number x such that x 2 = 2. This asser- 
tion is often expressed more briefly by saying that V2 is irrational. Note, 
however, that the use of the symbol Vl implies the existence of some number 
(necessarily irrational) whose square is 2. We have not proved that such a 
number exists and we can assert confidently that, at present, a proof is 
impossible for us. Any proof at this stage would have to be based on P1-P12 
(the only properties of R we have mentioned); since PI -PI 2 are also true for 
Q, the exact same argument would show that there is a rational number whose 
square is 2, and this we know is false. (Note that the reverse argument will 
not work — our proof that there is no rational number whose square is 2 cannot 
be used to show that there is no real number whose square is 2, because our 
proof used not only PI -PI 2 but also a special property of Q, the fact that every 
number in Q, can be written p/% for integers p and q.) 

This particular deficiency in our list of properties of the real numbers could, 
of course, be corrected by adding a new property which asserts the existence 
of square roots of positive numbers. Resorting to such a measure is, however, 
neither aesthetically pleasing nor mathematically satisfactory; we would still 
not know that every number has an nth root if n is odd, and that every positive 
number has an nth root if n is even. Even if we assumed this, we could not 
prove the existence of a number x satisfying x b + x + 1 =0 (even though 
there does happen to be one), since we do not know how to write the solution 
of the equation in terms of nth roots (in fact, it is known that the solution 
cannot be written in this form). And, of course, we certainly do not wish to 
assume that all equations have solutions, since this is false (no real number x 
satisfies x 2 + 1 - 0, for example). In fact, this direction of investigation is 
not a fruitful one. The most useful hints about the property distinguishing R 
from Q, the most compelling evidence for the necessity of elucidating this 



Numbers of Various Sorts 27 



property, do not come from the study of numbers alone. In order to study the 
properties of the real numbers in a more profound way, we must study more 
than the real numbers. At this point we must begin with the foundations of 
calculus, in particular the fundamental concept on which calculus is based — 
functions. 

PROBLEMS 
1. Prove the following formulas by induction. 



2 _ n(n + l)(2n+ 1) 



(i) 1 2 + • • • +n 2 = 

6 

(ii) l 3 + • • • + n 3 = (1 + • • • + n)\ 
Find a formula for 



(i) 2 ( 2i - *) = 1 + 3 + 5 + • ■ ■ + ( 2n - V- 

n 

(ii) £ (2i — I) 2 = 1 2 + 3 2 + 5 2 + • * * + (2n - l) 2 . 

i = l 

Hint: What do these expressions have to do with 1 + 2 + 3 + * • • + 
In and l 2 + 2 2 + 3 2 + • ■ • + (2n) 2 ? 

3. If 0 < k < w, the "binomial coefficient" ^ is defined by 



k) k\(n-k)\ k\ 

(^) = ( W ) = 1. (This becomes a special case of the first formula if we 
W W define 0! = 1.) 

(a) Prove that 

("rK:,K> 

(The proof does not require an induction argument.) 

This relation gives rise to the following configuration, known as 

"Pascal's triangle" — a number not on one of the sides is the sum of 

the two numbers above it; the binomial coefficient (^j is the kth 
number in the nth row. 

1 

1 1 
1 2 1 
13 3 1 
1 4 6 4 1 
1 5 10 10 5 1 



(b) Notice that all the numbers in Pascal's triangle are natural num- 
bers. Use part (a) to prove by induction that (^j is always a natural 

number. (Your entire proof by induction will, in a sense, be summed 
up in a glance by Pascal's triangle.) 

(c) Give another proof that (j^j is a natural number by showing that 

(^j is the number of sets of exactly k integers each chosen from 
1, . . . , n. 

(d) Prove the "binomial theorem": If a and b are any numbers and rcis 
a natural number, then 

(a + b) n = a n + (j) a^b + Q a»~W +••■+(„",) + *" 



"a""*. 



"SO 

(e) Prove that 

®2C)-G) 



< ii »s<- i K")=(o)-(0 + •••*(;)=»• 

4. (a) Prove by induction on that 

1 - r n+1 

1 + r + r 2 + • • • + r n = — 

1 — r 

ifr 1 (if r = 1, evaluating the sum certainly presents no problem), 
(b) Derive this result by setting S = 1 + r + * • • + r n , multiplying 
this equation by r, and solving the two equations for S. 

5. The formula for l 2 + • ■ ■ + n 2 may be derived as follows. We begin 
with the formula 

(k + l) 3 — k z — 3k* + 3k + l. 
Writing this formula for k = 1, . . . , n and adding, we obtain 
23 _ p = 3 . 12 + 3 . i + \ 
3 3 - 2 3 = 3-2 2 + 3-2 + 1 



(n + l) 3 - n* = 3'n 2 + 3-n + 1 



= 3[1 2 + • • • + n 2 ] + 3[1 + • • • + n] + n. 



(n + l) 3 - 1 
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n '* 

Thus we can find T k 2 if we already know £ £ (which could have been 
found in a similar way). Use this method to find 

(i) l 3 + • • • + n 3 . 

(ii) l 4 + • • • + n\ 

(hi) -*- + -!-+•••+ 1 



1-22-3 »(« + 1) 

3 5 2« + l , 

UVJ P-2 2 ' 2 2 -3 2 » 2 (rc + l) 2 

71 

Use the method of Problem 5 to show that Y P can always be written 
in the form 

^— + An' + En*- 1 + Cn^ 2 + • • • . 
p + \ 

(The first 10 such expressions are 

n 

V k = ih 2 + in 

n 

y F = ^ 3 +i/z 2 + 
k=l 

n 

\ k 3 = in' + W + |« 2 

n 

J /c 6 = i* 6 + *« 5 + A« 4 - tVrc 2 

: = 1 
n 

: = 1 

tF = |« 8 + V + ftll 4 - A" 4 + A" 2 

fix 

T F = + V + f rc 7 - A« 5 + l« 3 - A" 

: — 1 

n 

y f = ^«>o + £n« + f rc 8 - -jV 6 + - A" 2 

n 

Notice that the coefficients in the second column are always i, and that 
after the third column the powers of n with nonzero coefficients decrease 
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by 2 until n 2 or n is reached. The coefficients in all but the first two 
columns seem to be rather haphazard, but there actually is some sort of 
pattern; finding it may be regarded as a super-perspicacity test. See 
Problem 26-16 for the complete story.) 

7. Prove that every natural number is either even or odd. 

8. Prove that if a set A of natural numbers contains w 0 and contains k + 1 
whenever it contains k, then A contains all natural numbers > no. 

9. Prove the principle of mathematical induction from the well-ordering 
principle. 

10. Prove the principle of complete induction from the ordinary principle of 
induction. Hint: If A contains 1 and A contains n + 1 whenever it con- 
tains 1, . . . , n, consider the set B of all k such that 1, . . . , k are all 
in A. 

11. (a) If a is rational and b is irrational, is a + b necessarily irrational? 

What if a and b are both irrational? 

(b) If a is rational and b is irrational, is ab necessarily irrational? 
(Careful!) 

(c) Is there a number a such that a 2 is irrational, but a 4 is rational? 

(d) Are there two irrational numbers whose sum and product are both 
rational? 

12. (a) Prove that V3, V5, and Ve are irrational. Hint: To treat V3, for 

example, use the fact that every integer is of the form 3n or 3n + 1 
or 3n + 2. Why doesn't this proof work for V4? 
(b) Prove that and are irrational. 

*13. Prove that 

(a) V2 + V3 is irrational. 

(b) V6 - V2 - V3 is irrational. 

14. (a) Prove that if x = p + where p and q are rational, and m is a 

natural number, then x m = a + for some rational a and b. 

(b) Prove also that (p - V ' q) m = a - £ Vy. 

15. (a) Prove that if m and 72 are natural numbers and m 2 /n 2 < 2, then 

(m + In) 2 1 (m + n) 2 > 2; show, moreover, that 

(m + 2n) 2 _ 2<2 _m 2 ^ 
(m + n) 2 n 2 

(b) Prove the same results with all inequality signs reversed. 

(c) Prove that if m/n < V 2, then there is another rational number 
m'/n' with m/n < m f /n' < V 2. 

*16. It seems likely that V n is irrational whenever the natural number n is 
not the square of another natural number. Although the method of 
Problem 1 2 may actually be used to treat any particular case, it is not 
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clear in advance that it will always work, and a proof for the general 
case requires .ome extra information. A natural number p is called a 
prime number if it is impossible to write p = ab for natural numbers 
a and b unless one of these is p, and the other 1 ; for convenience we also 
agree that 1 is not a prime number. The first few prime numbers are 2, 
3, 5, 7, 11, 13, 17, 19. If n > 1 is not a prime, then n = ab, with a and b 
both < n; if either a or 6 is not a prime it can be factored similarly; con- 
tinuing in this way proves that we can write n as a product of primes. 
For example, 28 = 4 • 7 = 2 • 2 • 7. 

(a) Turn this argument into a rigorous proof by complete induction. 
(To be sure, any reasonable mathematician would accept the 
informal argument, but this is partly because it would be obvious 
to him how to state it rigorously.) 

A fundamental theorem about integers, which we will not prove here, 
states that this factorization is unique, except for the order of the factors. 
Thus, for example, 28 can never be written as a product of primes one 
of which is 3, nor can it be written in a way that involves 2 only once 
(now you should appreciate why 1 is not allowed as a prime). 

(b) Using this fact, prove that V 'n is irrational unless n = m 2 for some 
natural number m. 

(c) Prove more generally that is irrational unless n — nr. 

(d) No discussion of prime numbers should fail to allude to Euclid's 
beautiful proof that there are infinitely many of them. Prove that 
there cannot be only finitely many prime numbers pi, p 2 , pz, • . • , 
p n by considering pi - p 2 ' . . . • p n + I. 

*17. (a) Prove that if x satisfies 

x n + a n _ lX n - 1 + • • • + a Q = 0, 

for some integers a n ^ u . . . , a Q , then x is irrational unless x is an 
integer. (Why is this a generalization of Problem 16?) 
(b) Prove that V 2 + ^2 is irrational. Hint: Start by working out the 
first 6 powers of this number. 

18. Prove Bernoulli's inequality: If h > —1, then 

(1 + h) n > 1 + nh. 

Why is this trivial if h > 0 ? 

19. The Fibonacci sequence ai, a 2 , a 3 , . . . is defined as follows: 

ai = 1, 
ai = 1, 

a n = a n -i + for n > 3. 

This sequence, which begins 1, 1. 2, 3, 5, 8, . . . , was discovered by 
Fibonacci (circa 1175-1250), in connection with a problem about 
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rabbits. Fibonacci assumed that an initial pair of rabbits gave birth to 
one new pair of rabbits per month, and that after two months each new 
pair behaved similarly. The number a n of pairs born in the nth month is 
# n __i + a M _2, because a pair of rabbits is born for each pair born the 
previous month, and moreover each pair born two months ago now 
gives birth to another pair. The number of interesting results about this 
sequence is truly amazing — there is even a Fibonacci Association which 
publishes a journal, The Fibonacci Quarterly. Prove that 



V5 

One way of deriving this astonishing formula is presented in Problem 
23-8. 

20. ' The result in Problem 1-6 has an important generalization: If ai, . . . , 

a n > 0, then 

ai + . . . + q n 

vai ' . . . • a n < 

n 

(a) Why is this true if a x = ■ ■ ■ = a n ? Suppose not all a { are equal, 
say ai ^ aj. If a» and aj are both replaced by (a { + a^)/2 what 
happens to the "arithmetic mean" A n — (a\ + • • * + a n )/ n ? 
What happens to the "geometric mean 5 5 G n = Vai ' . . . ' a n ? 
Why does repeating this process enough times eventually prove 
that G n < A n ? (This is another place where it is a good exercise to 
provide a formal proof by induction, as well as informal reason.) 

The reasoning in the previous proof is closely related to another interest- 
ing proof. 

(b) Using the fact that G n < A n when n — 2, prove, by induction on 
k, that G n < A n for n = 2 k . 

(c) For a general n, let 2 m > n. Apply part (b) to the 2 m numbers 

a\, . . . , a n , A n , . . , A n 

2 m — n times 

to prove that G n < A n . 

21. The following is a recursive definition of a n : 

a 1 = a, 



Prove, by induction, that 

(a n ) m = a 



a n+m = a n • a m , 
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(Don't try to be fancy: use either induction on n or induction on m, not 
both at once.) 

22. Suppose we know properties PI and P4 for the natural numbers, but 
that multiplication has never' been mentioned. Then the following can 
be used as a recursive definition of multiplication: 

1 -b = b 9 
(a + 1) ■ b = a- b + b. 

Prove the following (in the order suggested!): 

a ' (b + c) — a ' b + a • c (use induction on a), 
a ' 1 = a, 

a - b = b ' a (you just finished proving the case b = 1). 

23. In this chapter we began with the natural numbers and gradually built 
up to the real numbers. A completely rigorous discussion of this process 
requires a little book in itself (see Part V). No one has ever figured out 
how to get to the real numbers without going through this process, but 
if we do accept the real numbers as given, then the natural numbers can 
be defined as the real numbers of the form 1,1 + 1,1 + 1 + 1, etc. The 
whole point of this problem is to show that there is a rigorous mathe- 
matical way of saying "etc." 

(a) A set A of real numbers is called inductive if 

(1) 1 is in A, 

(2) k + 1 is in A whenever k is in A. 
Prove that 

(i) R is inductive. 

(ii) The set of positive real numbers is inductive. 

(iii) The set of positive real numbers unequal to \ is inductive. 

(iv) The set of positive real numbers unequal to 5 is not inductive. 

(v) If A and B are inductive, then the set C of real numbers which 
are in both A and B is also inductive. 

(b) A real number n will be called a natural number if n is in every 
inductive set. 



(i) Prove that 1 is a natural number. 

(ii) Prove that k + 1 is a natural number if £ is a natural number. 




PART 
FOUNDATIONS 



The statement is so frequently made 
that the differential calculus deals with 
continuous magnitude, and yet 
an explanation of this continuity is 
nowhere given ; 

even the most rigorous expositions 
of the differential calculus do not base 
their proofs upon continuity but, 
with more or less consciousness of the fact, 
they either appeal to geometric notions 
or those suggested by geometry, 
or depend upon theorems which are never 
established in a purely arithmetic manner. 
Among these, for example, 
belongs the above-mentioned theorem, 
and a more careful investigation 
convinced me that this theorem, or 
any one equivalent to it, can be regarded 
in some way as a sufficient basis 
for infinitesimal analysis. 
It then only remained to discover its true- 
origin in the elements of arithmetic 
and thus at the same time 
to secure a real definition of 
the essence of continuity. 
I succeeded Nov. 24, 1858, and 
a few days afterward I communicated 
the results 

of my meditations to my dear friend 
Durege with whom I had a long 
and lively discussion. 



RICHARD DEDEKIND 



CHAPTER 




FUNCTIONS 



Undoubtedly the most important concept in all of mathematics is that of a 
function— in almost every branch of modern mathematics functions turn out 
to be the central objects of investigation. It will therefore probably not 
surprise you to learn that the concept of a function is one of great generality. 
Perhaps it will be a relief to learn that, for the present, we will be able to 
restrict our attention to functions of a very special kind; even this small class 
of functions will exhibit sufficient variety to engage our attention for quite 
some time. We will not even begin with a proper definition. For the moment 
a provisional definition will enable us to discuss functions at length, and will 
illustrate the intuitive notion of functions, as understood by mathematicians. 
Later, we will consider and discuss the advantages of the modern mathe- 
matical definition. Let us therefore begin with the following: 

PROVISIONAL DEFINITION A function is a rule which assigns, to each of certain real numbers, some other 

real number. 

The following examples of functions are meant to illustrate and amplify this 
definition, which, admittedly, requires some such clarification. 

Example 1 The rule which assigns to each number the square of that 
number. 

Example 2 The rule which assigns to each number y the number 

y* + 3y + 5 
r + 1 

Example 3 The rule which assigns to each number <? ^ 1, - 1 the number 

+ 3c + 5 
c 2 - 1 

Example 4 The rule which assigns to each number x satisfying -17 < 
x < 7r/3 the number x 2 . 

Example 5 The rule which assigns to each number a the number 0 it a is 
irrational, and the number 1 if a is rational. 

Example 6 The rule which assigns 

to 2 the number 5, 
to 17 the number — > 

7T 
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to — the number 28, 
17 

36 , 

to — the number 28, 

7T 

and to any y ^2, 17, 7r 2 /17, or 36/tt, the number 16 if is of the form a + 
b V2 for a, b in Q 

Example 7 The rule which assigns to each number 2 the number / 3 + x. 
(This rule depends, of course, on what the number x is, so we are really 
describing infinitely many different functions, one for each number x.) 

Example 8 The rule which assigns to each number z the number of 7's in 
the decimal expansion of z, if this number is finite, and — tt if there are 
infinitely many 7's in the decimal expansion of z. 

One thing should be abundantly clear from these examples — a function is 
any rule that assigns numbers to certain other numbers, not just a rule which 
can be expressed by an algebraic formula, or even by one uniform condition 
which applies to every number; nor is it necessarily a rule which you, or any- 
body else, can actually apply in practice (no one knows, for example, what 
rule 8 associates to tt). Moreover, the rule may neglect some numbers and it 
may not even be clear to which numbers the function applies (try to deter- 
mine, for example, whether the function in Example 6 applies to tt). The set of 
numbers to which a function does apply is called the domain of the function. 

Before saying anything else about functions we badly need some notation. 
Since throughout this book we shall frequently be talking about functions 
(indeed we shall hardly ever talk about anything else) we need a convenient 
way of naming functions, and of referring to functions in general. The standard 
practice is to denote a function by a letter. For obvious reasons the letter "/" 
is a favorite, thereby making "g" and other obvious candidates, but any 
letter (or any reasonable symbol, for that matter) will do, not excluding 
and "y," although these letters are usually reserved for indicating numbers. 
If/ is a function, then the number which / associates to a number x is denoted 
by /W— this symbol is read "/ of x" and is often called the value off at x. 
Naturally, if we denote a function by x, some other letter must be chosen to 
denote the number (a perfectly legitimate, though perverse, choice would be 
"/," leading to the symbol *(/)). Note that the symbol /(*) makes sense only 
for x in the domain of /; for other x the symbol f(x) is not defined. 

If the functions defined in Examples 1-8 are denoted by /, g 9 h, r, s, 0, a x , 
and y, then we can rewrite their definitions as follows: 

(1) f(x) = x 2 for all x. 

y 2 + 1 

(3) h(c) = 2 T for aI1 ' * 1, -1. 
c' — 1 
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(5) s{x) = 



(4) r(x) = x 2 for all x such that — 17 < x < tt/3. 

0, x irrational 

1, * rational. 

7 5, x = 2 

36 17 
— ' x = 17 



7T 



7T 



(6) flW = < 28 ' * 17 



'28, 
16, 



36 

x = — 

7T 

x ^ 2, 17, —j or — , and * = a + for a, b in Q. 

17 7T 



(7) a x (t) = t z + x for all numbers t. 

_ | n, exactly «7's appear in the decimal expansion of x 

(8) y(x) - I infinitely many 7 's appear in the decimal expansion of x. 

These definitions illustrate the common procedure adopted for defining a 
function /—indicating what f(x) is for every number x in the domain of /. 
(Notice that this is exactly the same as indicating f(a) for every number a, or 
f{b) for every number b, etc.) In practice, certain abbreviations are tolerated. 
Definition (1) could be written simply 

(1) f(x) = x\ 

the qualifying phrase "for all x" being understood. Of course, for definition 
(4) the only possible abbreviation is 

(4) r( x ) = x \ -17 < x < tt/3. 
It is usually understood that a definition such as 



can be shortened to 



kix) = -■ + — X — . x * 0, 1 
x x — 1 



*W = - + -^-7; 

a: — 1 



in other words, unless the domain is explicitly restricted further, it is understood to 
consist of all numbers for which the definition makes any sense at all. 

You should have little difficulty checking the following assertions about the 
functions defined above: 

/(*+ 1) =/(*) +2x+ 1; 

g(x) = h(x) if x 3 + 3x + 5 = 0; 

r(x + 1) = r{x) + 2x + 1 if -17 < x < | - 1; 



s(x + y) = s(x) if y is rational; 
a z (x) = x ■ [f(x) + 1]; 



If the expression f(s(a)) looks unreasonable to you, then you are forgetting 
that s(a) is a number like any other number, so that f(s(a)) makes sense. As 
a matter of fact, f(s(a)) = s(a) for all a. Why? Even more complicated expres- 
sions than f(s(a)) are, after a first exposure, no more difficult to unravel. The 
expression 

formidable as it appears, may be evaluated quite easily with a little patience: 

f(r(s(0(az(y(i)))))) 
= f(r(s(6(aM)))) 
= /(rW9(3)))) 
= /(rW16))) 
= /(r(l)) 

-/(I) 
= 1. 

The first few problems at the end of this chapter give further practice manipu- 
lating this symbolism. 

The function defined in (1) is a rather special example of an extremely 
important class of functions, the polynomial functions. A function / is a 
polynomial function if there are real numbers a 0 , . . . , a n such that 

/(*) = a n x n + a n „ix n ~ l + • • • + a 2 x 2 + aiX + a 0 , for all x 

(when f{x) is written in this form it is usually tacitly assumed that a n 0). 
The highest power of x with a nonzero coefficient is called the degree of/; 
for example, the polynomial function / defined by /(*) = 5x 6 + 137* 4 — tt 
has degree 6. 

The functions defined in (2) and (3) belong to a somewhat larger class of 
functions, the rational functions; these are the functions of the form p/q 
where p and q are polynomial functions (and q is not the function which is 
always 0). The rational functions are themselves quite special examples of an 
even larger class of functions, very thoroughly studied in calculus, which are 
simpler than many of the functions first mentioned in this chapter. The 
following are examples of this kind of function: 

ro\ f( \ x ± x 2 + * sin2 * 

(9) fix) = ; ; — — 

x sin x + x sm z x 

(10) fix) = s'mix 2 ). 

(11) fix) = sin(sin(^ 2 )). 
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, v „, s . n «^ . fx + sin(# sin #)\ 

(12) /(*) = sin 2 (sin(sin 2 (* sin 2 * 2 ))) • sin ( — - )• 

\ x + sin x / 

By what criterion, you may feel impelled to ask, can such functions, especially 
a monstrosity like (12), be considered simple? The answer is that they can be 
built up from a few simple functions using a few simple means of combining 
functions. In order to construct the functions (9)— (12) we need to start with 
the "identity function" 7, for which I(x) = x, and the "sine function" sin, 
whose value sin(#) at x is often written simply sin x. The following are some 
of the important ways in which functions may be combined to produce new 
functions. 

If / and g are any two functions, we can define a new function / + g, called 
the sum of / and g, by the equation 

(f + g)(x) =f(x)+g(x). 

Note that according to the conventions we have adopted, the domain of / + g 
consists of all x for which "/(*) + makes sense, i.e., the set of all x in both 

domain /and domain g. If A and B are any two sets, then A C\ B (read "A inter- 
sect B" or "the intersection of A and Z?") denotes the set of x in both A and B; 
this notation allows us to write domain (/ + g) = domain / Pi domain g. 

In a similar vein, we define the product / • g and the quotient - (or f/g) 

g 

of / and g by 

(/•*)(*)=/(*)•*(*) 

and 

Moreover, if g is a function and c is a number, we define a new function c • g by 

(c g)(x) = c ' g(x). 

This becomes a special case of the notation / • g if we agree that the symbol c 
should also represent the function / defined by fix) — c; such a function, 
which has the same value for all numbers x, is called a constant function. 

The domain of / * g is domain / C\ domain g, and the domain of c * g is 
simply the domain of g. On the other hand, the domain of f/g is rather com- 
plicated — it may be written domain / domain g C\ {x: g(x) ^0}, the 
symbol \x: g(x) ^ 0} denoting the set of numbers x such that g(x) ^ 0. In 
general, {x: . . .} denotes the set of all x such that ". . ." is true. Thus 
{x: x z + 3 < 11} denotes the set of all numbers x such that x 3 < 8, and 
consequently {x: x* + 3 < 1 1 } = \x: x < 2} . Either of these symbols could 
just as well have been written using y everywhere instead of x. Variations of 
this notation are common, but hardly require any discussion. Any one can 
guess that {x > 0: * 3 < 8} denotes the set of positive numbers whose cube is 
less than 8; it could be expressed more formally as {x: x > 0 and x* < 8}. 



Incidentally, this set is equal to the set {x: 0 < x < 2}. One variation is 
slightly less transparent, but very standard. The set {1, 3, 2, 4}, for example, 
contains just the four numbers 1, 2, 3, and 4; it can also be denoted by 
{x: x = 1 or x = 3 or ^ = 2 or ^ = 4). 

Certain facts about the sum, product, and quotient of functions are obvious 
consequences of facts about sums, products, and quotients of numbers. For 
example, it is very easy to prove that 

(f + g ) + h = /+ ( g + k). 

The proof is characteristic of almost every proof which demonstrates that two 
functions are equal — the two functions must be shown to have the same domain, 
and the same value at any number in the domain. For example, to prove that 
(f + g) + h = f + (g + h), note that unraveling the definition of the two 
sides gives 

Kf + g)+h](x) = (f + g)(x) + h(x) 

= [/(*) + *(*)] + *W 

and 

U+(g + h)](x) =/(*) + (g + k)(x) 

= /(*) + UW + Kx)l 

and the equality of [/(*) + g(x)] + h(x) and f(x) + [g(x) + h(x)] is a fact 
about numbers. In this proof the equality of the two domains was not explicitly 
mentioned because this is obvious, as soon as we begin to write down these 
equations; the domain of (/ + g) + h and of / + (g + h) is clearly domain 
/ H domain g C\ domain h. We naturally write / + g + h for (/ + g) + 
h = f + (g + h), precisely as we did for numbers. 

It is just as easy to prove that (/ • g) • h = f • (g * h), and this function is 
denoted by / • g • h. The equations / + g = g + / and f'g=g '/should also 
present no difficulty. 

Using the operations +, •, / we can now express the function / defined in 
(9) by 

_ I + I • I + I ' sin • sin 
/ • sin + / • sin • sin 

It should be clear, however, that we cannot express function (10) this way. 
We require yet another way of combining functions. This combination, the 
composition of two functions, is by far the most important. 

If / and g are any two functions, we define a new function / ° g, the com- 
position of / and g, by 

(/•*)(*) =/(*«); 

the domain of fog is {x: x is in domain g and g(x) is in domain /}. The 
symbol u /o g » is often read "/ circle g" Compared to the phrase "the com- 
position of / and g" this has the advantage of brevity, of course, but there is 
another advantage of far greater import: there is much less chance of confusing 
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fog with g o /, and these must not be confused, since they are not usually 
equal; in fact, almost any / and g chosen at random will illustrate this point 
(try f = I - 1 and g = sin, for example). Lest you become too apprehensive 
about the operation of composition, let us hasten to point out that composition 
is associative: 



(and the proof is a triviality) ; this function is denoted by / ° g ° h. We can now 
write the functions (10), (11), (12) as 

(10) / = sine (/•/), 

(11) / - sin o sine (/•/), 

(12) / = (sin • sin) o sin o (sin • sin) ° (/ ■ [(sin - sin) o (/ • /)]) • 



One fact has probably already become clear. Although this method of writing 
functions reveals their "structure" very clearly, it is hardly short or con- 
venient. The shortest name for the function / such that f(x) = sin(x 2 ) for all 
x unfortunately seems to be "the function / such that f(x) = sin(x 2 ) for 
all x." The need for abbreviating this clumsy description has been clear for 
two hundred years, but no reasonable abbreviation has received universal 
acclaim. At present the strongest contender for this honor is something like 



(read "x goes to sin(# 2 )" or just u x arrow sin(* 2 )"), but it is hardly popular 
among writers of calculus textbooks. In this book we will tolerate a certain 
amount of ellipsis, and speak of "the function f(x) = sin(x 2 )." Even more 
popular is the quite drastic abbreviation: "the function sin(* 2 )." For the sake 
of precision we will never use this description, which, strictly speaking, con- 
fuses a number and a function, but it is so convenient that you will probably 
end up adopting it for personal use. As with any convention, utility is the 
motivating factor, and this criterion is reasonable so long as the slight logical 
deficiencies cause no confusion. On occasion, confusion will arise unless a 
more precise description is used. For example, "the function x + * 3 " is an 
ambiguous phrase; it could mean either 

x — > x + t z } i.e., the function / such that f(x) = x + / 3 for all x 



t—>x + t 3 , i.e., the function / such that /(/) = x + t z for all t. 

As we shall see, however, for many important concepts associated with func- 
tions, calculus has a notation which contains the "x — >" built in. 

By now we have made a sufficiently extensive investigation of functions to 
warrant reconsidering our definition. We have defined a function as a "rule," 
but it is hardly clear what this means. If we ask "What happens if you break 
this rule?" it is not easy to say whether this question is merely facetious or 



(fog) o h = fo (g oh) 




x — ► sin(* 2 ) 



or 



actually profound. A more substantial objection to the use of the word "rule" 
is that 

f(x) = x* 

and 

f(x) = x 2 + 3x + 3 - 3(* + 1) 

are certainly different rules, if by a rule we mean the actual instructions given 
for determining fix) ; nevertheless, we want 

fix) - x 2 

and 

fix) = x 2 + 3* + 3 - 30 + 1) 

to define the same function. For this reason, a function is sometimes defined 
as an "association" between numbers; unfortunately the word "association" 
escapes the objections raised against "rule" only because it is even more 
vague. 

There is, of course, a satisfactory way of defining functions, or we should 
never have gone to the trouble of criticizing our original definition. But a 
satisfactory definition can never be constructed by finding synonyms for 
English words which are troublesome. The definition which mathematicians 
have finally accepted for "function" is a beautiful example of the means by 
which intuitive ideas have been incorporated into rigorous mathematics. The 
correct question to ask about a function is not "What is a rule?" or "What is 
an association?" but "What does one have to know about a function in 
order to know all about it?" The answer to the last question is easy — for each 
number x one needs to know the number fix) ; we can imagine a table which 
would display all the information one could desire about the function 
/(*)=*»: 



X 


fix) 


1 


1 


-1 


1 


2 


4 


-2 


4 


V2 


2 


V2 


2 


7T 


TT 2 


— TT 


TT 2 



It is not even necessary to arrange the numbers in a table (which would 
actually be impossible if we wanted to list all of them). Instead of a two 
column array we can consider various pairs of numbers 



(1, 1), (-1, 1), (2, 4), (-2, 4), (t, tt 2 ), (V2, 2), 
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simply collected together into a set.* To find /(I) we simply take the second 
number of the pair whose first member is 1 ; to find f(w) we take the second 
number of the pair whose first member is 7r. We seem to be saying that a func- 
tion might as well be defined as a collection of pairs of numbers. For example, 
if we were given the following collection (which contains just 5 pairs) : 

/ = {(1,7), (3,7), (5,3), (4,8), (8,4)}, 

then /(l) = 7,/(3) = 7,/(5) = 3,/(4) = 8,/(8) = 4 and 1, 3, 4, 5, 8 are the 
only numbers in the domain of/. If we consider the collection 

/= {(1,7), (3, 7), (2, 5), (1,8), (8, 4)}, 

then /(3) = 7, f{2) = 5, /(8) = 4; but it is impossible to decide whether 
/(l) = 7 or/(l) = 8. In other words, a function cannot be defined to be any 
old collection of pairs of numbers; we must rule out the possibility which 
arose in this case. We are therefore led to the following definition. 



A function is a collection of pairs of numbers with the following property: 
if (a, b) and {a, c) are both in the collection, then b = c; in other words, the 
collection must not contain two different pairs with the same first element. 



This is our first full-fledged definition, and illustrates the format we shall 
always use to define significant new concepts. These definitions are so impor- 
tant (at least as important as theorems) that it is essential to know when one 
is actually at hand, and to distinguish them from comments, motivating 
remarks, and casual explanations. They will be preceded by the word 
DEFINITION, contain the term being defined in boldface letters, and con- 
stitute a paragraph unto themselves. 

There is one more definition (actually defining two things at once) which 
can now be made rigorously: 



If / is a function, the domain of / is the set of all a for which there is some b 
such that (a, b) is in /. If a is in the domain of/, it follows from the definition 
of a function that there is, in fact, a unique number b such that (a, b) is in/. 
This unique b is denoted by /(a). 



With this definition we have reached our goal: the important thing about 
a function / is that a number fix) is determined for each number x in its 
domain. You may feel that we have also reached the point where an intuitive 
definition has been replaced by an abstraction with which the mind can 
hardly grapple. Two consolations may be offered. First, although a function 

* The pairs occurring here are often called "ordered pairs," to emphasize that, for example, 
(2, 4) is not the same pair as (4, 2). It is only fair to warn that we are going to define functions 
in terms of ordered pairs, another undefined term. Ordered pairs can be defined, however, 
and an appendix to this chapter has been provided for skeptics. 



has been defined as a collection of pairs, there is nothing to stop you from 
thinking of a function as a rule. Second, neither the intuitive nor the formal 
definition indicates the best way of thinking about functions. The best way 
is to draw pictures; but this requires a chapter all by itself. 

PROBLEMS 

1. Let/M = 1/(1 +*)■ What is 

(0 f(f( x )) (f° r which x does this make sense?). 

m /©. 

(hi) f(cx). 

(iv) f(x+y). 

(v) /M+/G0. 

(vi) For which numbers c is there a number x such that /(ex) = f(x). 
Hint: There are a lot more than you might think at first glance. 

(vii) For which numbers c is it true that f(cx) = f(x) for two different 
numbers x? 

2. Let g(x) = x 2 , and let 

fa( x \ __ | 0, x rational 

(1, a irrational. 

(i) For which _y is A(jy) < y? 

(ii) For which jy is h(y) < g(y)? 

(iii) What is - 

(iv) For which w is g(w) < w? 

(v) For which s is g(g(e)) = ^(s)? 

3. Find the domain of the functions defined by the following formulas. 

(i) f{x) = V ] - x\ 

(ii) /(*) = - Vi - x \ 

(iii) fix) = -J- + -L-. 

x — 1 * — 2 

(iv) /(*) = V j - * 2 + Vx 2 - 1. 

(v) /(*) - Vl - x + V* -~2. 

4. Let = a: 2 , let P(x) = 2*, and let s(x) = sin a. Find each of the 
following. In each case your answer should be a number. 

(i) (J"*) GO. 

(ii) ,)(,). 

(iii) (5.P.j)(i) + (jo *)(/). 
(iv) 

5. Express each of the following functions in terms of S, P, s, using only 
+ , - , and o (for example, the answer to (i) is P o s). In each case your 
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answer should be a function. 

(i) f(x) = 2 ain *. 

(ii) f(x) = sin 2*. 

(iii) /(*) = sin x 2 . 

(iv) /(*) = sin 2 x (remember that sin 2 x is an abbreviation for 
(sin x) 2 ). 

( v ) f(t) = 2 2 \ (Note: a bc always means a m ; this convention is adopted 
because (a b ) c can be written more simply as a hc .) 

(vi) f{u) = sin (2* + 2- 2 ). 

(vii) f(y) = sin(sin(sin(2 22iin, ')))• 

(viii) = 2 sin2a + sin (a 2 ) + 2 sin(a2+sina) . 

Polynomial functions, because they are simple, yet flexible, occupy a favored 
role in most investigations of functions. The following two problems illustrate 
their flexibility, and guide you through a derivation of their most important 
elementary properties. 

6. (a) If x h . . . , x n are distinct numbers, find a polynomial function 

fi of degree n — 1 which is 1 at and 0 at Xj for; Hint: The 
product of all (x - x<) for ; ^ i, is 0 at xj if ; ^ i. (This product 
is usually denoted by 

n 

n (* - *i)> 

; = 1 

the symbol II (capital pi) playing the same role for products that 
2 plays for sums.) 
(b) Now find a polynomial function / of degree n — 1 such that /(*»•) = 
Gi, where a h . . . , a n are given numbers. (You should use the 
functions /< from part (a). The formula you will obtain is called the 
"Lagrange interpolation formula.' 5 ) 

7. (a) Prove that for any polynomial function /, and any number a, there 

is a polynomial function g, and a number b> such that /(*) = 
(x - fl^W + b for all *. (The idea is simply to divide (x - a) into 
/(*) by long division, until a constant remainder is left. For example, 
the calculation 

x 2 +x -2 
x - l)x 3 -3x + 1 

x 3 —x 2 

x 2 —3x 
x 2 —x 

^2x + 1 
-2x + 2 



-1 
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shows that x s - 3* + 1 = ( x - l)(x 2 + x - 2) - 1. A formal 
proof is possible by induction on the degree of/.) 

(b) Prove that if f(a) = 0, then /(*) = (* - a)g(x) for some poly- 
nomial function g. (The converse is obvious.) 

(c) Prove that if/ is a polynomial function of degree w, then /has at most 
n roots, i.e., there are at most n numbers a with f{a) = 0. 

(d) Show that for each n there is a polynomial function of degree n with 
n roots. If h is even find a polynomial function of degree n with no 
roots, and if n is odd find one with only one root. 

8. For which numbers a, b y c, and d will the function 

ax + d 
cx + b 

satisfy /(/(*)) = * for all x ? 

9. (a) If A is any set of real numbers, define a function C A as follows: 



C A (x) = 



1 , * in A 

0, # not in A. 



Find expressions for C A n B and C^ wB and Cr_ a , in terms of C A and 
C B . (The symbol A C\ B was defined in this chapter, but the other 
two may be new to you. They can be defined as follows: 

A VJ B — {x: x is in A or x is in B}, 

R — A = {x: x is in R but * is not in A}.) 

(b) Suppose /is a function such that f(x) = 0 or 1 for each x. Prove that 
there is a set A such that / = C A . 

(c) Show that / = / 2 if and only if / = C A for some set A. 

10. (a) For which functions / is there a function g such that / = g 2 ? Hint: 

You can certainly answer this question if "function" is replaced by 
"number. 55 

(b) For which functions / is there a function g such that / = 1 Ig ? 
*(c) For which functions b and c can we find a function x such that 

OW) 2 + b(t)x(t) + c(t) = 0 

for all numbers t ? 
*(d) What conditions must the functions a and b satisfy if there is to be 
a function x such that 

a{t)x(t) +b{t) = 0 

for all numbers ^ ? How many such functions x will there be? 

11. (a) Suppose that His a function and y is a number such that H(H(y)) = 

y. What is 

H(H(H(- ■ ■ (H(y) • • •) ? 



80 times 
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(b) Same question if 80 is replaced by 81. 

(c) Same question if H(H{y)) = H(y). 

*(d) Find a function H such that H(H(x)) = H(x) for all numbers x, 
and such that H{\) = 36, H(2) = tt/3, 7/(13) = 47, //(36) = 36, 
//(tt/3) - tt/3, 7/(47) = 47. (Don't try to "solve" for H(x); there 
are many functions //with H{H(x)) = H(x). The extra conditions 
on H are supposed to suggest a way of finding a suitable H.) 

*(e) Find a function //such that H(H(x)) = //(#) for all #, and such that 
H{\) = 7, //(17) = 18. 
12. A function / is even if f(x) = f(—x) and odd if f(x) = —/(—*). For 

example, / is even if f(x) = x 2 or /(*) = \x\ or /(*) = cos x, while / is 

odd if f(x) = x or /(#) = sin 

(a) Determine whether / + g is even, odd, or not necessarily either, in 
the four cases obtained by choosing /even or odd, and g even or odd. 
(Your answers can most conveniently be displayed in a 2 X 2 
table.) 

(b) Do the same for / • g. 

(c) Do the same for f ° g. 

(d) Prove that every even function / can be written f(x) — g{\x\), f° r 
infinitely many functions g. 

*13. (a) Prove that any function /with domain R can be written/ = E 4- 0, 
where E is even and 0 is odd. 
(b) Prove that this way of writing / is unique. (If you try to do pan; (b) 
first, by "solving" for E and 0 you will probably find the solution 
to part (a).) 

14. If /is any function, define a new function |/| by |/|(*) = | /(*)!• ^ /and 
g are functions, define two new functions, max(/, g) and min(/, g), by 

max (/,£)(*) = max (/(*), g(x)), 
min (/,$)(*) - min(/(*), £(*)). 

Find an expression for max(/, g) and min(/, g) in terms of | |. 

15. (a) Show that / = max(/, 0) + min(/, 0). This particular way of 

writing / is fairly useful; the functions max(/, 0) and min(/, 0) are 
called the positive and negative parts of /. 
(b) A function / is called nonnegative if f(x) > 0 for all x. Prove that 
any function / can be written / = g — h, where g and h are non- 
negative, in infinitely many ways. (The "standard way" is g — 
max(/, 0) and h = — min(/, 0).) Hint: Any number can certainly 
be written as the difference of two nonnegative numbers in infinitely 
many ways. 

*16. Suppose / satisfies f(x + y) - f(x) + f(y) for all x and y. 



(a) Prove that/fo /(*,) + • • • +/(*«). 
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(b) Prove that there is some number c such that fix) — cx for all rational 
numbers x (at this point we're not trying to say anything about fix) 
for irrational x). Hint: First figure out what c must be. Now prove 
that f{x) = cx, first when x is a natural number, then when x is an 
integer, then when x is the reciprocal of an integer and, finally, for 
all rational x. 

*17. If fix) = 0 for all x, then / satisfies f(x + y) = fix) + fiy) for all x and 
y, and also fix • y) ~ fix) • fiy) for all x and y. Now suppose that / 
satisfies these two properties, but that fix) is not always 0. Prove that 
fix) = x for all x, as follows: 

(a) Prove that/(l) = 1. 

(b) Prove that fix) = x if x is rational. 

(c) Prove that fix) > 0 if x > 0. (This part is tricky, but if you have 
been paying attention to the philosophical remarks accompanying 
the problems in the last two chapters, you will know what to do.) 

(d) Prove that fix) > fiy) if x > y. 

(e) Prove that fix) = x for all x. Hint: Use the fact that between any 
two numbers there is a rational number. 

*18. Precisely what conditions must /, g, h, and k satisfy in order that fix)giy) 

= hix)kiy) for all x and y? 
*19. (a) Prove that there do not exist functions / and g with either of the 
following properties: 

(i) fix) + giy) = xy for all x and y. 

(ii) fix + y) = gix) — y for all x and y. 

Hint: Try to get some information about / or g by choosing par- 
ticular values of x and y, 
(b) Find functions / and g such that fix + y) = gixy) for all x and y. 
*20. (a) Find a function /, other than a constant function, such that \ fiy) — 

/Ml < \y-*V 

(b) Suppose that fiy) - fix) < iy - x) 2 for all x and y. (Why does this 
imply that \fiy) - f{x)\ < iy - x) 2 ?) Prove that / is a constant 
function. Hint: Divide the interval [x,y] into n equal pieces. 

21. Prove or give a counterexample for each of the following assertions: 

(a) foig + h) =fo g +fo h . 

(b) ig + h)of = gof+ k of. 
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22. (a) Suppose g = h ° /. Prove that if /(#) = /(j), then £(*) = £(>»). 

(b) Conversely, suppose that / and g are two functions such that g{x) — 
g(y) whenever f(x) = f(y). Prove that g = h ° / for some function 
k. Hint: Just try to define h(z) when z is of the form z = f{x) (these 
are the only z that matter) and use the hypotheses to show that your 
definition will not run into trouble. 

23. Suppose that f ° g = I, where I(x) = x. Prove that 

(a) if x ^ y, then g{x) ^ g(y); 

(b) every number b can be written b = f(a) for some number a. 

*24. (a) Suppose g is a function with the property that g(x) 5* g(y) if x 9^ y. 
Prove that there is a function / such that fog = I. 
(b) Suppose that / is a function such that every number b can be 
written b — f(a) for some number a. Prove that there is a function 
g such that fog = I. 
*25. Find a function / such that g °f = / for some g, but such that there is no 

function h with / ° h = /. 
*26. Suppose f ° g = I and h°f = I. Prove that g = h. Hint: Use the fact 
that composition is associative. 

27. (a) Suppose f(x) = x + 1. Are there any functions g such that f ° g — 

(b) Suppose / is a constant function. For which functions g does f ° g — 

g°f? 

(c) Suppose that / o g = g o / for all functions g. Show that / is the 
identity function, f(x) = x. 

28. (a) Let F be the set of all functions whose domain is R. Prove that, 

using + and * as defined in this chapter, all of properties P1-P9 
except P7 hold for F, provided 0 and 1 are interpreted as constant 
functions, 
(b) Show that P7 does not hold. 

*(c) Show that P10-P12 cannot hold. In other words, show that there is 
no collection P of functions in F, such that P10-P12 hold for P. (It 
is sufficient, and will simplify things, to consider only functions 
which are 0 except at two points x 0 and xi.) 

(d) Suppose we define / < g to mean that f(x) < g(x) for all x. Which 
of P'lO-P'H (in Problem 1-8) now hold? 

(e) If / < g, is h of < h o g ? Is / o h < g o h ? 
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APPENDIX. ORDERED PAIRS 

Not only in the definition of a function, but in other parts of the book as 
well, it is necessary to use the notion of an ordered pair of objects. A definition 
has not yet been given, and we have never even stated explicitly what properties 
an ordered pair is supposed to have. The one property which we will require 
states formally that the ordered pair (a, b) should be determined by a and b, 
and the order in which they are given: 

if (a, b) — (c, d), then a — c and b — d. 

Ordered pairs may be treated most conveniently by simply introducing 
{a, b) as an undefined term and adopting the basic property as an axiom — 
since this property is the only significant fact about ordered pairs, there is not 
much point worrying about what an ordered pair "really" is. Those who find 
this treatment satisfactory need read no further. 

* The rest of this short appendix is for the benefit of those readers who will 
feel uncomfortable unless ordered pairs are somehow defined so that this 
basic property becomes a theorem. There is no point in restricting our atten- 
tion to ordered pairs of numbers; it is just as reasonable, and just as important, 
to have available the notion of an ordered pair of any two mathematical 
objects. This means that our definition ought to involve only concepts com- 
mon to all branches of mathematics. The one common concept which pervades 
all areas of mathematics is that of a set, and ordered pairs (like everything 
else in mathematics) can be defined in this context; an ordered pair will turn 
out to be a set of a rather special sort. 

The set {a, b}, containing the two elements a and b, is an obvious first 
choice, but will not do as a definition for (a, b), because there is no way of 
determining from {a, b\ which of a or b is meant to be the first element. A 
more promising candidate is the rather startling set: 

{{a},{a,b}}. 

This set has two members, both of which are themselves sets; one member is the 
set {a}, containing the single member a, the other is the set {a,b}. Shocking 
as it may seem, we are going to define (a, b) to be this set. The justification 
for this choice is given by the theorem immediately following the definition — ■ 
the definition works, and there really isn't anything else worth saying. 



DEFINITION 



<0, b) = {{a}, {a,b}). 



THEOREM i If (a, b) = (c, d) 9 then a = c and b = d. 



PROOF The hypothesis means that 

{{«}, {a,b}} = {{c}, {c,d}\ 
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Now {{a}, {a, b}} contains just two members, {a} and {a, b}; and a is the 
only common element of these two members of {{a}, {a, b) }. Similarly, c is 
the unique common member of both members of {{c}, {c, d\\. Therefore 
a = c. We therefore have 

{{a}, \a,b\\ = {{a}, \a,d\\, 

and only the proof that b = d remains. It is convenient to distinguish 2 cases. 

Case 7. b = a. In this case, {a, b\ = \a\, so the set { {a}, {a, b] } really has only 
one member, namely, {a}. The same must be true of { { a \ , { a, d \ \ , so { a, d } = 
\a\, which implies that d = a — b. 

Case 2. b 9* a. In this case, b is in one member of { {a}, {a, b} ) but not in the 
other. It must therefore be true that b is in one member of {{a}, {a, d\ } but 
not in the other. This can happen only if ^ is in { a, d\ , but b is not in {a}; thus 
b = a or b = d, but b 9^ a; so b = d. | 
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Mention the real numbers to a mathematician and the image of a straight 
line will probably form in his mind, quite involuntarily. And most likely he 
will neither banish nor too eagerly embrace this mental picture of the real 
numbers. "Geometric intuition" will allow him to interpret statements about 
numbers in terms of this picture, and may even suggest methods of proving 
them. Although the properties of the real numbers which were studied in 
Part I are not greatly illuminated by a geometric picture, such an interpreta- 
tion will be a great aid in Part II. 

You are probably already familiar with the conventional method of con- 
sidering the straight line as a picture of the real numbers, i.e., of associating 
-i oil 2 3 to each real number a point on a line> To do this (Figure 1) we pick, arbi- 

figure i trarily, a point which we label 0, and a point to the right, which we label 1. 

The point twice as far to the right is labeled 2, the point the same distance 
from 0 to 1, but to the left of 0, is labeled —1, etc. With this arrangement, if 
a < b, then the point corresponding to a lies to the left of the point corre- 
sponding to b. We can also draw rational numbers, such as ^> in the obvious 
way. It is usually taken for granted that the irrational numbers also somehow 
fit into this scheme, so that every real number can be drawn as a point on the 
line. We will not make too. much fuss about justifying this assumption, since 
this method of "drawing" numbers is intended solely as a method of picturing 
certain abstract ideas, and our proofs will never rely on these pictures (al- 
though we will frequently use a picture to suggest or help explain a proof). 
Because this geometric picture plays such a prominent, albeit inessential role, 
geometric terminology is frequently employed when speaking of numbers — 
thus a number is sometimes called a point, and R is often called the real line. 

The number \a — b\ has a simple interpretation in terms of this geometric 
picture: it is the distance between a and b, the length of the line segment which 
has a as one end point and b as the other. This means, to choose an example 
whose frequent occurrence justifies special consideration, that the set of 
numbers x which satisfy \x — a\ < £ may be pictured as the collection of 
points whose distance from a is less than s. This set of points is the "interval" 

~ — ■ .■ \ . v a from a — £ to a + £, which may also be described as the points corresponding 

a ~ £ a a + £ to numbers x with a — e < x < a + e (Figure 2). 

figure 2 g ets Q £ num j :)ers which correspond to intervals arise so frequently that it is 

desirable to have special names for them. The set {x: a < x < b) is denoted 
by (a, b) and called the open interval from a to b. This notation naturally 
creates some ambiguity, since (a, b) is also used to denote a pair of numbers, 
but in context it is always clear (or can easily be made clear) whether one is 
talking about a pair or an interval. Note that if a > b, then (a, b) = 0, the set 
54 



Graphs 55 



with no elements; in practice, however, it is almost always assumed (explicitly 
if one has been careful, and implicitly otherwise), that whenever an interval 
(a, b) is mentioned, the number a is less than b. 

The set {x: a < x < b] is denoted by [a, b] and is called the closed interval 
from atob. This symbol is usually reserved for the case a < b, but it is some- 
times used for a = 6, also. The usual pictures for the intervals (<z, b) and 
[a, b] are shown in Figure 3; since no reasonably accurate picture could ever 
indicate the difference between the two intervals, various conventions have 
been adopted. Figure 3 also shows certain "infinite" intervals. The set 
{x: x > a} is denoted by (a, oo), while the set {x: x > a} is denoted by [a, oo); 
the sets ( — oo, and (— oo, a] are defined similarly. At this point a standard 
warning must be issued: the symbols °o and — oo, though usually read 
"infinity" and "minus infinity," are purely suggestive; there is no number 
" oc " which satisfies oo > a for all numbers a. While the symbols oo and — oo 
will appear in many contexts, it is always necessary to define these uses in 
ways that refer only to numbers. The set R of all real numbers is also con- 
sidered to be an "interval," and is sometimes denoted by (— oo, oo). 

Of even greater interest to us than the method of drawing numbers is a 
method of drawing pairs of numbers. This procedure, probably also familiar 
to you, requires a "coordinate system," two straight lines intersecting at right 
angles. To distinguish these straight lines, we call one the horizontal axis, and 
one the vertical axis. (More prosaic terminology, such as the "first" and 
"second" axes, is probably preferable from a logical point of view, but most 
people hold their books, or at least their blackboards, in the same way, so that 
"horizontal" and "vertical" are more descriptive.) Each of the two axes could 
be labeled with real numbers, but we can also label points on the horizontal 
axis with pairs (a, 0) and points on the vertical axis with pairs (0, b), so that 
the intersection of the two axes, the "origin" of the coordinate system, is 
labeled (0, 0). Any point (a, b) can now be drawn as in Figure 4, lying at the 
vertex of the rectangle whose other three vertices are labeled (0, 0), (a, 0), 
and (0, b). The numbers a and b are called the first and second coordinates, 
respectively, of the point determined in this way. 

Our real concern, let us recall, is a method of drawing functions. Since a 
function is just a collection of pairs of numbers, we can draw a function by 
drawing each of the pairs in the function. The drawing obtained in this way 
is called the graph of the function. In other words, the graph of / contains 
all the points corresponding to pairs (*,/(#)). Since most functions contain 
infinitely many pairs, drawing the graph promises to be a laborious under- 
taking, but, in fact, many functions have graphs which are quite easy to draw. 

Not surprisingly, the simplest functions of all, the constant functions 
f(x) = c, have the simplest graphs. It is easy to see that the graph of the func- 
tion f(x) = c is a straight line parallel to the horizontal axis, at distance c 
from it (Figure 5). 

The functions f(x) ~ cx also have particularly simple graphs — straight 
lines through (0, 0), as in Figure 6. A proof of this fact is indicated in Figure 7: 
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FIGURE 7 
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Let x be some number not equal to 0, and let L be the straight line which 
passes through the origin 0, corresponding to (0, 0), and through the point 
A, corresponding to (x, cx). A point A\ with first coordinate y, will lie on L 
when the triangle A'B'O is similar to the triangle ABO, thus when 



A'B' 
OB' 



AB 
OB 



= c; 



this is precisely the condition that A' correspond to the pair (j, cy), i.e., that 
A' lies on the graph of /. The argument has implicitly assumed that c > 0, but 
the other cases are treated easily enough. The number c, which measures the 
ratio of the sides of the triangles appearing in the proof, is called the slope of the 
straight line, and a line parallel to this line is also said to have slope c. 

This demonstration has neither been labeled nor treated as a formal proof. 
Indeed, a rigorous demonstration would necessitate a digression which we are 
not at all prepared to follow. The rigorous proof of any statement connecting 
geometric and algebraic concepts would first require a real proof (or a pre- 
cisely stated assumption) that the points on a straight line correspond in 
an exact way to the real numbers. Aside from this, it would be necessary to 
develop plane geometry as precisely as we intend to develop the properties of 
real numbers. Now the detailed development of plane geometry is a beautiful 
subject, but it is by no means a prerequisite for the study of calculus. We shall 
use geometric pictures only as an aid to intuition; for our purposes (and for 
most of mathematics) it is perfectly satisfactory to define the plane to be the 
set of all pairs of real numbers, and to define straight lines as certain collections 
of pairs, including, among others, the collections } (*, cx):xa real number } . To 
provide this artificially constructed geometry with all the structure of geometry 
studied in high school, one more definition is required. If (a, b) and (c, d) are 
two points in the plane, i.e., pairs of real numbers, we define the distance 
between (a, b) and (c, d) to be 



V( a - cY + (b- d)\ 

If the motivation for this definition is not clear, Figure 8 should serve as 
adequate explanation— with this definition the Pythagorean theorem has 
been built into our geometry.* 

Reverting once more to our informal geometric picture, it is not hard to 
see (Figure 9) that the graph of the function f(x) = cx + d is a straight line 
with slope c y passing through the point (0, d). For this reason, the functions 
/(*) = cx + d are called linear functions. Simple as they are, linear functions 
occur frequently, and you should feel comfortable working with them. The 
following is a typical problem whose solution should not cause any trouble. 
Given two distinct points {a, b) and (c, d), find the linear function / whose 

* The fastidious reader might object to this definition on the grounds that nonnegative numbers 
are not yet known to have square roots. This objection is really unanswerable at the moment 
—the definition will just have to be accepted with reservations, until this little point is settled. 
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graph goes through (a, b) and (c, d). This amounts to saying that f(a) = b and 
f(c) = d. If / is to be of the form f(x) = ax + f3, then we must have 

aa + (3 = b, 
ac + 0 = rf; 

therefore a = (rf - £)/(<; - a) and /3 = b - [(«/ - b)/(c - a)]a, so 

, . d — b d — b d — b N 

c — a c — a c — a 

a formula most easily remembered by using the "point-slope form" (see 
Problem 5). 

Of course, this solution is possible only if a ^ c; the graphs of linear functions 
account only for the straight lines which are not parallel to the vertical axis. 
The vertical straight lines are not the graph of any function at all; in fact, the 
graph of a function can never contain even two distinct points on the same 
vertical line. This conclusion is immediate from the definition of a function — 
two points on the same vertical line correspond to pairs of the form (a, b) and 
(a, c) and, by definition, a function cannot contain (a, b) and (a, c) if b 9^ c. 
Conversely, if a set of points in the plane has the property that no two points 
lie on the same vertical line, then it is surely the graph of a function. Thus the 
first 2 sets in Figure 10 are not graphs of functions and the last 2 are; notice 
that the fourth is the graph of a function whose domain is not all of R, since 
some vertical lines have no points on them at all. 

After the linear functions the simplest is perhaps the function f(x) = x 2 . 
If we draw some of the pairs in /, i.e., some of the pairs of the form (x, x 2 ), we 
obtain a picture like Figure 1 1 . 
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It is not hard to convince yourself that all the pairs (x, x 2 ) lie along a curve 
like the one shown in Figure 12; this curve is known as a parabola. 

Since a graph is just a drawing on paper, made (in this case) with printer's 
ink, the question "Is this what the graph really looks like?" is hard to phrase 
in any sensible manner. No drawing is ever really correct since the line has 
thickness. Nevertheless, there are some questions which one can ask: for 
example, how can you be sure that the graph does not look like one of the 
drawings in Figure 13? It is easy to see, and even to prove, that the graph 
cannot look like (a); for if 0 < x < y, then x 2 < y 2 , so the graph should be 
higher at y than at x, which is not the case in (a). It is also easy to see, simply 
by drawing a very accurate graph, first plotting many pairs (x, x 2 ), that the 
graph cannot have a large "jump" as in (b) or a "corner" as in (c). In order 
to prove these assertions, however, we first need to say, in a mathematical 
way, what it means for a function not to have a "jump" or "corner"; these 
ideas already involve some of the fundamental concepts of calculus. Eventually 
we will be able to define them rigorously, but meanwhile you may amuse 
yourself by attempting to define these concepts, and then examining your 
definitions critically. Later these definitions may be compared with the ones 
mathematicians have agreed upon. If they compare favorably, you are cer- 
tainly to be congratulated ! 

The functions f(x) = x n , for various natural numbers are sometimes 
called power functions. Their graphs are most easily compared as in Figure 
14, by drawing several at once. 

The power functions are only special cases of polynomial functions, intro- 
duced in the previous chapter. Two particular polynomial functions are 
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graphed in Figure 15, while Figure 16 is meant to give a general idea of the 
graph of the polynomial function 



in the case a n > 0. 

In general, the graph of / will have at most n — 1 "peaks" or "valleys" (a 
"peak" is a point like (*,/(*)) in Figure 16, while a "valley" is a point like 
(y> f(y))- The number of peaks and valleys may actually be much smaller (the 
power functions, for example, have at most one valley). Although these 
assertions are easy to make, we will not even contemplate giving proofs until 
Part III (once the powerful methods of Part III are available, the proofs will 
be very easy). 

Figure 17 illustrates the graphs of several rational functions. The rational 
functions exhibit even greater variety than the polynomial functions, but their 
behavior will also be easy to analyze once we can use the derivative, the basic 
tool of Part III. 

Many interesting graphs can be constructed by "piecing together" the 
graphs of functions already studied. The graph in Figure 18 is made up 
entirely of straight lines. The function / with this graph satisfies 



and is a linear function on each interval [l/(w + 1), l/n] and [ — 1/n, 
— \l(n + 1)]. (The number 0 is not in the domain of /.) Of course, one can 
write out an explicit formula for f(x), when x is in [\/{n + 1), 1/w] ; this is a 
good exercise in the use of linear functions, and will also convince you that a 
picture is worth a thousand words. 



/(*) = a n x n + a n _ x x n ~ l + • • • + a 0 , 
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"N. f(x) = sin * 
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It is actually possible to define, in a much simpler way, a function which 
exhibits this same property of oscillating infinitely often near 0, by using the 
sine function. In Chapter 15 we will discuss this function in detail, and 
radian measure in particular; for the time being it will be easiest to use degree 
measurements for angles. The graph of the sine function is shown in Figure 19 
(the scale on the horizontal axis has been altered so that the graph will be 
clearer; radian measure has, besides important mathematical properties, the 
additional advantage that such changes are unnecessary). 

Now consider the function f(x) = sin 1/x. The graph of / is shown in 
Figure 20. (To draw this graph it helps to first observe that 

fix) =0 for x = -^—> — !— ) — - — j * * * 9 

180 360 540 

f(x) = 1 for x = — > 



90 90 + 360 90 + 720 



fix) = — 1 for x = —i — — ^ j ) • * • 

270 270 + 360 270 + 720 / 

Notice that when x is large, so that 1/x is small, f(x) is also small; when x 
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is "large negative, 55 that is, when [*| is large for negative x, again f(x) is close 
to 0, although /(*) < 0. 

An interesting modification of this function is f(x) = x sin 1 fx. The graph 
of this function is sketched in Figure 21 . Since sin 1 /x oscillates infinitely often 
near 0 between 1 and —1, the function f(x) = x sin 1/x oscillates infinitely 
often between x and —x. The behavior of the graph for x large or large nega- 




FIGURE 22 
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tive is harder to analyze. Since sin 1/x is getting close to 0. while x is getting 
larger and larger, there seems to be no telling what the product will do. It is 
possible to decide, but this is another question that is best deferred to Part 
III. The graph of f(x) = x 2 sin 1/x has also been illustrated (Figure 22). 

For these infinitely oscillating functions, it is clear that the graph cannot 
hope to be really " accurate." The best we can do is to show part of it, and 
leave out the part near 0 (which is the interesting part). Actually, it is easy 
to find much simpler functions whose graph cannot be "accurately 55 drawn. 
The graphs of 

£f v I x 2 , x < 1 , f , \ x 2 , x < 1 

can only be distinguished by some convention similar to that used for open 
and closed intervals (Figure 23). 

Our last example is a function whose graph is spectacularly nondrawable: 




0, x irrational 

1, x rational. 



1, x rational 
0, x irrational 



FIGURE 24 

The graph of/ must contain infinitely many points on the horizontal axis and 
also infinitely many points on a line parallel to the horizontal axis, but it must 
not contain either of these lines entirely. Figure 24 shows the usual textbook 
picture of the graph. To distinguish the two parts of the graph, the dots are 
placed closer together on the line corresponding to irrational x. (There is 
actually a mathematical reason behind this convention, but it depends on 
some sophisticated ideas, introduced in Problems 20-6* and 20-7.) 

The peculiarities exhibited by some functions are so engrossing that it is 
easy to forget some of the simplest, and most important, subsets of the plane, 
which are not the graphs of functions. The most important example of all is 
the circle. A circle with center (a, b) and radius r > 0 contains, by definition, 
all the points (#, y) whose distance from (a, b) is equal to r. The circle thus 
consists (Figure 25) of all points (x, y) with 

V( x ~ a) 2 + (y - b) 2 = r 

or 

(x - a) 2 + (y - b) 2 = r 2 . 



The circle with center (0, 0) and radius 1, often regarded as a sort of standard 
copy, is called the unit circle. 

A close relative of the circle is the ellipse. This is defined as the set of points, 
the sum of whose distances from two fixed points is a constant. (When the two 
fixed points are the same, we obtain a circle.) If, for convenience, the two 
points are taken to be (—c, 0) and (c, 0), and the sum of the distances is taken 
to be 2a (the factor 2 simplifies some algebra), then (x,y) is on the ellipse if 
and only if 

V( x - {-c)) 2 +y 2 + V( x - c) 2 +y 2 = 2a 

or 

V(* + c) 2 +y 2 = 2a - V( x - c) 2 + y 2 

or 

x 2 + lex + c 2 + y 2 = 4a 2 - 4a V ( x - c) 2 + y 2 + x 2 - lex + c 2 + y 2 

or 

4{cx - a 2 ) = -4a V ( x - c) 2 + y 2 

or 

c 2 x 2 - lexa 2 + a A = a 2 (x 2 - lex + c 2 + y 2 ) 

or 

(c 2 - a 2 )x 2 - a 2 y 2 - a 2 [c 2 - a 2 ) 

or 




This is usually written simply 




where c 2 (since we must clearly choose a > c, it follows that 

a 2 — c 2 > 0). A picture of an ellipse is shown in Figure 26. The ellipse 
intersects the horizontal axis when y = €, so that 

* 2 1 + 
— = 1, x = ±a, 

a 2 




(0, -b) 



FIGURE 26 
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and it intersects the vertical axis when x = 0, so that 



The hyperbola is defined analogously, except that we require the difference 
of the two distances to be constant. Choosing the points (— c, 0) and (c, 0) 
once again, and the constant difference as 2a, we obtain, as the condition that 
(x, y) be on the hyperbola, 

V( x + c y + y 2 - V( x - c) 2 + f = ±2a, 
which may be simplified to 

- + y2 = 1 

a 2 a 2 — c 2 

In this case, however, we must clearly choose c > a, so that a 2 — c 2 < 0. If 
b = Vc 2 — a 2 , then (x,y) is on the hyperbola if and only if 

- z! = i 

The picture is shown in Figure 27. It contains two pieces, because the differ- 
ence between the distances of (x,y) from (— c, 0) and (e, 0) may be taken in 
two different orders. The hyperbola intersects the horizontal axis when y = 0, 
so that x = ± a, but it never intersects the vertical axis. 

It is interesting to compare (Figure 28) the hyperbola with a = b = V2 
and the graph of the function f(x) = 1/x. The drawings look quite similar, 
and the two sets are actually identical, except for a rotation through an angle 
of 45° (Problem 21). 

Clearly no rotation of the plane will change circles or ellipses into the 
graphs of functions. Nevertheless, the study of these important geometric 
figures can often be reduced to the study of functions. Ellipses, for example, are 




FIGURE 28 



made up of the graphs of two functions, 

./(*) = b Vl - (**/**), -a<x<a 

and 

g ( x ) = -b Vl - (x 2 /a 2 ), -a<x<a. 

Of course, there are many other pairs of functions with this same property. 
For example, we can take 



fix) = 

and 

g(x) = 



b Vl - (x*/a*), 0 < x < a 

-b Vl - (x 2 /a 2 ), -a < x < 0 

-b Vl - (x 2 /a 2 ), 0<x<a 

b Vl - (x 2 /a 2 ), -a<x<0. 



We could also choose 



f( x ) = I ° — (x 2 /a 2 ), x rational, — a < x < a 
b Vl — (x 2 /a 2 ), x irrational, — a < x < a 



and 



^ = | — b V \ — (x 2 /a 2 ), x rational, — a < x < a 
{ b y/\ — (x 2 /a 2 ), x irrational, — a < x < a. 

But all these other pairs necessarily involve unreasonable functions which 
jump around. A proof, or even a precise statement of this fact, is too difficult 
at present. Although you have probably already begun to make a distinction 
between those functions with reasonable graphs, and those with unreasonable 
graphs, you may find it very difficult to state a reasonable definition of reason- 
able functions. A mathematical definition of this concept is by no means 
easy, and a great deal of this book may be viewed as successive attempts 
to impose more and more conditions that a ''reasonable 5 ' function must 
satisfy. As we define some of these conditions, we will take time out to ask if we 
have really succeeded in isolating the functions which deserve to be called 
reasonable. The answer, unfortunately, will always be "no," or at best, a 
qualified "yes." 



PROBLEMS 

1. Indicate on a straight line the set of all x satisfying the following condi- 
tions. Also name each set, using the notation for intervals (in some cases 
you will also need the KJ sign). 

(i) |* - 3| < 1. 

(ii) \x - 3| < 1. 
(hi) j* — a\ < e. 
(iv) |* 2 - 1| < 
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(vi) — < a (give an answer in terms of a, distinguishing various 

1 + x 2 

cases). 

(vii) x 2 + 1 > 2. 

(viii) (x + 1)(* - 1)(* - 2) > 0. 

2. Draw the set of all points (*, ;y) satisfying the following conditions. (In 
most cases your picture will be a sizable portion of a plane, not just a 
line or curve.) 

(i) x > y. 

(ii) x + a > y + b. 

(iii) y < x 2 . 

(iv) y < x 2 . 

(v) |*-j|<1. 

(vi) |*+j|<1. 

(vii) x + y is an integer. 

(vm) is an integer. 

* + y 

(ix) (* - 1) 2 + (y - 2) 2 < 1. 

(x) x 2 < y < x\ 

3. Draw the set of all points (x, y) satisfying the following conditions. 

« M + \y\ = 1- 

(ii) k| - H = i. 

(iii) 1^-11 = 1^-11. 

(iv) 11-^ = 1^-11. 

(v) * 2 + ^ 2 = 0. 

(vi) xy = 0. 

(vii) - 2* + y 2 = 4. 

(viii) # 2 = y 2 . 

4. Draw the set of all points (x, y) satisfying the following conditions: 
(i) x=y 2 . 




(iii) x = \y\. 

(iv) x = sin y. 



Hint: You already know the answers when x and y are interchanged. 

5. (a) Show that the straight line through {a, b) with slope m is the graph 
of the function f(x) = m(x — a) + b. This formula, known as the 



"point-slope form" is far more convenient than the equivalent 
expression fix) = mx + (b — ma) ; it is immediately clear from the 
point-slope form that the slope is m, and that the value of / at 
a is b. 

(b) For a ^ c, show that the straight line through (a, b) and (c, d) is the 
graph of the function 

/(*) = (x-a)+ b. 

c — a 

(c) When are the graphs of fix) = mx + b and g(x) = m'x + b' parallel 
straight lines? 

(a) For any numbers A, B, and C, with A and B not both 0, show that 
the set of all (x, y) satisfying Ax + By + C = 0 is a straight line 
(possibly a vertical one). Hint: First decide when a vertical straight 
line is described. 

(b) Show conversely that every straight line, including vertical ones, 
can be described as the set of all (x,y) satisfying Ax + By + C = 0. 

(a) Prove that the graphs of the functions 

fix) = mx + b, 
g(x) = nx + c, 

are perpendicular if mn — —1, by computing the squares of the 
lengths of the sides of the triangle in Figure 29. (Why is this special 
case, where the lines intersect at the origin, as good as the general 
case?) 

(b) Prove that the two straight lines consisting of all (x,y) satisfying 
the conditions 

Ax + By + C = 0, 
A'x + B'y + C = 0, 

are perpendicular if and only if A A' + BB' = 0. 

(a) Prove, using Problem 1-18, that 

+yi) 2 + (x 2 +y 2 ) 2 < vV + X2 * + VyS+yS. 

(b) Prove that 

V(*8 -*i) 2 + (yz ~yi) 2 < ^(x 2 ~ x,Y + (y 2 - yi y 

+ y/(x 9 -xt)*+(y 9 -yt)\ 

Interpret this inequality geometrically (it is called the "triangle 

inequality"). When does strict inequality hold? 
Sketch the graphs of the following functions, plotting enough points to 
get a good idea of the general appearance. (Part of the problem is to 
make a reasonable decision how many is "enough"; the queries posed 
below are meant to show that a little thought will often be more valuable 
than hundreds of individual points.) 
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(i) f( x ) = x -\ (What happens for x near 0, and for large x? Where 

does the graph lie in relation to the graph of the identify function? 
Why does it suffice to consider only positive x at first?) 

(ii) f(x) = x - 

X 

(iii) f(x) = * 2 + i. 

# 2 

(iv) /(*) = * 2 - - 2 - 

10. Describe the general features of the graph of / if 

(i) / is even. 

(ii) / is odd. 

(iii) / is nonnegative. 

(iv) f(x) = f{x + a) for all x (a function with this property is called 
periodic, with period a). 

11. Graph the functions fix) = for m = 1, 2, 3, 4. (There is an easy 
way to do this, using Figure 14. Be sure to remember, however, that 

means the positive mth root of x when m is even ; you should also note 
that there will be an important difference between the graph when m is 
even and when m is odd.) 

12. (a) Graph fix) = |*| and fix) = x\ 

(b) Graph fix) = |sin*| and fix) = sin 2 *. (There is an important 
difference between the graphs, which we cannot yet even describe 
rigorously. See if you can discover what it is; part (a) is meant to 
be a clue.) 

13. Describe the graph of g in terms of the graph of / if 

(i) gix) = fix) + c. 

(ii) gix) = fix + c). (It is easy to make a mistake here.) 

(iii) gix) = cfix) ( D i st i ngu i sh t he cases c = 0, c > 0, c < 0.) 

(iv) gix) = ficx). 

(v) gix) =/(lA). 

(vi) gix) =fi\x\). 

(vii) gix) = l/M I . 

(viii) £(*) = max(/, 0). 

(ix) £(*) = min(/, 0). 

(x) £(*) = max(/, 1). 

14. Draw the graph of fix) = ax 2 + bx + c. Hint: Use the methods of 
Problem 1-17. 



15. The symbol [x] denotes the largest integer which is Thus [2.1] = 
[2] = 2 and [-0.9] = [-1.2] = -1. Draw the graph of the following 
functions (they are all quite interesting, and several will reappear 
frequently in other problems). 

(0 /(*) = [•*]• 

(ii) /(*) = x - [v]. 

(iii) fix) = V X - fx]. 

(iv) f{x) = M + V x - [ X ]. 

(v) /(*) = [I]- 

(vi) fix) = 4r 



16. Graph the following functions. 

(i) /(*) = {*}, where {*} is defined to be the distance from x to the 
nearest integer. 

(ii) f(x) = {2*}. 

(iii) fix) = {x} + %{2x). 

(iv) fix) - {4*}. 

(v) fix) = {x} +i\2x\ +i\4x\. 



Many functions may be described in terms of the decimal expansion of a 
number. Although we will not be in a position to describe infinite decimals 
rigorously until Chapter 22, your intuitive notion of infinite decimals should 
suffice to carry you through the following problem, and others which occur 
before Chapter 22. There is one ambiguity about infinite decimals which 
must be eliminated: Every decimal ending in a string of 9's is equal to another 
ending in a string of 0's (e.g., 1.23999 . . . = 1.24000 . . .). We will always 
use the one ending in 9's 

*17. Describe as best you can the graphs of the following functions (a com- 
plete picture is usually out of the question). 

(0 fix) — the 1st number in the decimal expansion of x. 

(ii) fix) = the 2nd number in the decimal expansion of x. 

(iii) fix) = the number of 7 ? s in the decimal expansion of x if this 
number is finite, and 0 otherwise. 

(iv) fix) — 0 if the number of 7's in the decimal expansion of x is 
finite, and 1 otherwise. 

( v ) /(*) = the number obtained by replacing all digits in the decimal 
expansion of x which come after the first 7 (if any) by 0. 

(vi) fix) = 0 if 1 never appears in the decimal expansion of x, and n 
if 1 first appears in the 72th place. 
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*18. Let 

x irrational 




x = - rational in lowest terms. 

q 

(A number p/q is in lowest terms Hp and q are integers with no common 
factor, and q > 0). Draw the graph of / as well as you can (don't 
sprinkle points randomly on the paper; consider first the rational num- 
bers with q = 2, then those with q = 3, etc.). 
19. (a) The points on the graph of f(x) = x 2 are the ones of the form (x, x 2 ). 

Prove that each such point is equidistant from the point (0, i) and 

the graph of g(x) = -|. (See Figure 30.) 
(b) Given a point P = (a, fi) and a horizontal line L, the graph of 

g( x ) = Y) show that the set of all points (*, y) equidistant from P and 

L is the graph of a function of the form f(x) ax 2 + bx + c. 
*20. (a) Show that the square of the distance from (c, d) to (x, mx) is 

x 2 (m 2 + 1) + x(-2md - 2c) + d 2 + c 2 . 

Using Problem 1-17 to find the minimum of these numbers, show 
that the distance from (c, d) to the graph of /(*) = mx is 

\cm - d\/Vm 2 + 1. 

(b) Find the distance from (c, d) to the graph of /(*) = mx + b. 
(Reduce this case to part (a).) 
*21. (a) Using Problem 20, show that the numbers x' and / indicated in 
Figure 31 are given by 

1 i 1 

(b) Show that the set of all (x,y) with (x'/V2)* - (vV^) 2 = 1 is the 
same as the set of all (x, y) with xy = 1 . 



CHAPTER 




LIMITS 



The concept of a limit is surely the most important, and probably the most 
difficult one in all of calculus. The goal of this chapter is the definition of 
limits, but we are, once more, going to begin with a provisional definition; 
what we shall define is not the word "limit" but the notion of a function 
approaching a limit. 

PROVISIONAL DEFINITION The function / approaches the limit / near a, if we can make fix) as close as we 

like to / by requiring that x be sufficiently close to, but unequal to, a. 

Of the six functions graphed in Figure 1, only the first three approach / at a. 
Notice that although g(a) is not defined, and h{a) is defined "the wrong way," 
it is still true that g and h approach / near a. This is because we explicitly 
ruled out, in our definition, the necessity of ever considering the value of the 
function at a — it is only necessary that f(x) should be close to / for x close to a, 
but unequal to a. We are simply not interested in the value of f(a). or even in 
the question of whether f(a) is defined. 




FIGURE 1 



One convenient way of picturing the assertion that / approaches / near a is 
provided by a method of drawing functions that was not mentioned in 
Chapter 4. In this method, we draw two straight lines, each representing R, 
and arrows from a point x in one, to f(x) in the other. Figure 2 illustrates such 
a picture for two different functions. 

72 
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Now consider a function / whose drawing looks like Figure 3. Suppose we 
ask that /(*) be close to /, say within the open interval B which has been 
drawn in Figure 3. This can be guaranteed if we consider only the numbers x 
in the interval A of Figure 3. (In this diagram we have chosen the largest 
interval which will work; any smaller interval containing a could have been 
chosen instead.) If we choose a smaller interval B' (Figure 4) we will, usually, 
have to choose a smaller A\ but no matter how small we choose the open 
interval B, there is always supposed to be some open interval A which works. 

A similar pictorial interpretation is possible in terms of the graph of/, but 
in this case the interval B must be drawn on the vertical axis, and the set A 
on the horizontal axis. The fact that f(x) is in B when x is in A means that the 
part of the graph lying over A is contained in the region which is bounded 
by the horizontal lines through the end points of B; compare Figure 5(a), 
where a valid interval A has been chosen, with Figure 5(b), where A is too 
large. 

In order to apply our definition to a particular function, let us consider 
/(*) = x sin 1/x (Figure 6). Despite the erratic behavior of this function near 
0 it is clear, at least intuitively, that / approaches 0 near 0. and it is cer- 
tainly to be hoped that our definition will allow us to reach the same con- 
clusion. In the case we are considering, both a and / of the definition are 0, so 
we must ask if we can get /(*) = x sin 1/x as close to 0 as desired if we require 
that x be sufficiently close to 0, but ^ 0. To be specific, suppose we wish to 
get x sin 1 /x within ^ of 0. This means we want 

1 .11 

— ■ — - < x sin - < — > 
10 x 10 

or, more succinctly, \x sin l/x\ < to- Now this is easy. Since 

sin - < 1, for all x ^ 0, 

x 
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we have 







4 


s f(x) = x sin 


/ 

/ 






\ 

\ 

\ 



FIGURE 6 



f(x) = y/\x\ sin 




FIGURE 8 



* sin - 

X 



< 1*1, for all x * 0. 



This means that if |*| < xo an d x ^ 0, then |* sin 1/*| < y^-; in other words, 
x sin 1/x is within y 1 ^ of 0 provided that x is within yo of 0, but ^ 0. There 
is nothing special about the number y^; it is just as easy to guarantee that 
\f(x) — 0| < j-q-q — simply require that |*| < y^, but x ^ 0. In fact, if we 
take any positive number £ we can make \f(x) — 0| < £ simply by requiring 
that |*| < £, and * ^ 0. 

For the function /(*) = x 2 sin 1/x (Figure 7) it seems even clearer that / 
approaches 0 near 0. If, for example, we want 



x £ sin - 
* 



1 

< io 



then we certainly need only require that |*| < y^ and * 9± 0, since this implies 
that |* 2 | < yJ~o and consequently 




FIGURE 7 



(We could do even better, and allow |*| < 1 /Vio and * 5^ 0, but there is no 
particular virtue in being as economical as possible.) In general, if £ > 0, to 
ensure that 



< e, 



we need only require that 



|*| < £ and * 0, 
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FIGURE 9 



provided that £ < 1 . If we are given an £ which is greater than 1 (it might be, 
even though it is "small" e's which are of interest), then it does not suffice to 
require that |*| < e, but it certainly suffices to require that |*| < 1 and x 5* 0. 
As a third example^consider the function /(*) = V|*| sin \/x (Figure 8)- 
iin I In order to make sin l/x\ < £ we can require that 

|*| < £ 2 and x ^ 0, 

if £ < 1, or that |*| < 1 and x 5* 0 if £ > 1 (the algebra is left to you). 

Finally, let us consider the function f(x) = sin 1/x (Figure 9). For this 
function it is false that /approaches 0 near 0. This amounts to saying that it is 
not true for every number £ > 0 that we can get \f(x) — 0| < £ by choosing 
x sufficiently small, and ^ 0. To show this we simply have to find one £ > 0 
for which the condition \f(x) - 0| < £ cannot be guaranteed, no matter how 
small we require |*| to be. In fact, £ = % will do: it is impossible to ensure that 
|/(x)| < i no matter how small we require |*| to be; for if A is any interval con- 
taining 0, there is some number * = 1/(90 + 360rc) which is in this interval, 
and for this x we have f(x) = 1 . 

This same argument can be used (Figure 10) to show that / does not 
approach any number near 0. To show this we must again find, for any par- 
ticular number /, some number £ > 0 so that \f(x) — /| < £ is not true, no 
matter how small x is required to be. The choice £ = i works for any number 
/; that is, no matter how small we require |*| to be, we cannot ensure that 
_ /| < The reason is, that for any interval A containing 0 there is 
some #1 = 1 /(90 + 360«) in this interval, so that 

and also some x 2 - 1/(270 + 360m) in this interval, so that 

/(**) = -I- 
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/(*) 



i x, x rational 
I 0, x irrational 



FIGURE 11 





c_±J m 


f( X ) = c 


c — e 






) . 

a 



FIGURE 12 



1 


^ /to = i,*> o 




b 

/(*) = -1, x < 0 . 


-1 





FIGURE 13 



But the interval from / - £ to / + * cannot contain both -1 and 1, since its 
total length is only 1 ; so we cannot have 

|1 - /| < iand also |-1 - /[ < 

no matter what / is. 

The phenomenon exhibited by /(*) = sin 1/x near 0 can occur in many 
ways. If we consider the function 



/(*) 



-(?: 



x irrational 
x rational, 

then, no matter what a is, / does not approach any number / near a. In fact 
we cannot make \f{x) - l\ < \ n o matter how close we bring x to a, because 
m any interval around a there are numbers x with /(*) = 0, and also numbers 
x with f(x) = 1, so that we would need |0 - l\ < \ and also |1 - l\ < \. 
^ An amusing variation on this behavior is presented by the function shown 
in Figure 1 1 : 

f(x) = | *' * ^tional 
I 0, # irrational. 

The behavior of this function is "opposite" to that of g(x) = sin 1/x; it 
approaches 0 at 0 S but does not approach any number at a, if a * 0. By now 
you should have no difficulty convincing yourself that this is true. 

As a contrast to the functions considered so far, which have been quite 
pathological, we will now examine some of the simplest functions. 

If/(*) = c, then /approaches c near a, for every number a. In fact, to ensure 
that I/O) - c\ < s one does not need to restrict x to be near a at all; the condi- 
tion is automatically satisfied (Figure 12). 

As a slight variation, let / be the function shown in Figure 13: 



x < 0 
x > 0. 



If a > 0, then /approaches 1 near a: indeed, to ensure that \f(x) — 1 1 < e it 
certainly suffices to require that \x - a\ < a, since this implies 

a <C x a 
or 0 < x, 

so that/W = 1. Similarly, if * < 0, then / approaches -1 near b: to ensure 
that |/0) - (-1)| < e it suffices to require that |* - £| < Finally, as 
you may easily check, / does not approach any number near 0. 

The function /(*) = x is easily dealt with. Clearly / approaches a near a: to 
ensure that |/0) - a\ < £ we just have to require that |* - a \ < £. 

The function /0) = ^r 2 requires a little more work. To show that / ap- 
proaches a 2 near a, we must decide how to ensure that 



k 2 - a 2 \ < £. 
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Factoring looks like the most promising procedure: we want 

|* — a\ ' \x + a\ < £. 

Obviously the factor |* + a\ is the one that will cause trouble. On the other 
hand, there is no need to make \x + a\ particularly small; as long as we know 
some bound on the values of \x + a\ we will be in good shape. For example, 
if \x + a\ < 1,000,000, then we will just need to require that |* — a\ < 
e/1 ,000,000. Therefore, to begin with, let us require that \x — a\ < 1 (any 
positive number other than 1 would do just as well) ; presumably this will 
ensure that x is not too large, and consequently that \x + a\ is not too large. 
As a matter of fact, Problem 1-12 shows that 

\x\ - \a\ <\x - a\ < 1. 

so 

H < i + kl, 

and consequently 

\x + a\ < \x\ + \a\ < 2\a\ + 1. 

Now we need only the additional requirement that \x — a\ < z/{2\a\ + 1). 
In other words, 

if \x - a\ < min ( l r — \ then \x 2 - a 2 \ < s. 

\ 2\a\ + 1/ 

Naturally, min(l, e/(2\a\ + 1)) will just be e/(2\a\ + 1) for small e. 

Precisely the same sort of trick will show that if f(x) = x s , then / approaches 
a z near a. In fact, 

if \x - a\ < min ( 1, — ~4 rr, nz) 9 then l^ 3 a *\ < e ' 

1 ' \ (1 + \a\r+ \a\(\ + \a\) + \a\*J 

The proof of this assertion will show where the weird denominator comes 
from: If \x — a\ < 1, then |*| < \a\ + 1, and consequently 

\x 2 + ax + a 2 \ < \x\ 2 + \a\ ' \x\ + \a\* 

< (1 + \a\y+ \a\(l + \a\) + \a\\' 

Therefore 

_ fl 8| = \ x _ fl | . ^2 + ax + a 2 \ 

< n 4-1 h 2 -Li hi iui^ * [(1 + ^ l)2 + W(1 + M) + W] 
(1 + \a\) 2 + + \a\) + \a\ 2 

= £. 

The time has now come to point out that of the many demonstrations about 
limits which we have given, not one has been a real proof. The fault lies not 
with our reasoning, but with our definition. If our provisional definition of 
a function was open to criticism, our provisional definition of approaching a 
limit is even more vulnerable. This definition is simply not sufficiently precise 
to be used in proofs. It is hardly clear how one "makes" f(x) close to / (what- 
ever "close" means) by "requiring" x to be sufficiently close to a (however 
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close "sufficiently" close is supposed to be). Despite the criticisms of our 
definition you may feel (I certainly hope you do) that our arguments were 
nevertheless quite convincing. In order to present any sort of argument at all, 
we have been practically forced to invent the real definition. It is possible to 
arrive at this definition in several steps, each one clarifying some obscure 
phrase which still remains. Let us begin, once again, with the provisional 
definition: 

The function / approaches the limit / near a, if we can make/(*) as close 
as we like to / by requiring that x be sufficiently close to, but unequal to, a. 

The very first change which we made in this definition was to note that making 
/0) close to / meant making \f(x) - i\ small, and similarly for x and a: 

The function / approaches the limit / near a, if we can make \f(x) - /| 
as small as we like by requiring that \x - a\ be sufficiently small, and 
x 9^ a. 

The second, more crucial, change was to note that making |/(*) - l\ "as 
small as we like" means making \f(x) - l\ < £ for any £ > 0 that happens to 
be given us : 

The function / approaches the limit / near a, if for every number £ > 0 
we can make \f{x) — /| < e by requiring that \x - a\ be sufficiently 
small, and x ^ a. 

There is a common pattern to all the demonstrations about limits which we 
have given. For each number £ > 0 we found some other positive number, 
8 say, with the property that if x a and \x - a\ < <5, then \f(x) — /| < e. 
For the function /(*) = x sin \Jx ( with a « 0, / = 0), the number <$ was just 
the number £; for f(x) = V\ x \ sin 1/x, it was £ 2 if £ < 1, and it was 1 if 
£ > 1; for/<» = x 2 it was the minimum of 1 and e/(2\a\ + 1). In general, it 
may not be at all clear how to find the number <5, given £, but it is the condi- 
tion \x — a\ < 8 which expresses how small " sufficiently" small must be: 

The function / approaches the limit / near a, if for every £ > 0 there is 
some 5 > 0 such that, for all *, if \x - a\ < 6 and x ^ a, then \f(x) - l\ 

< £. 

This is practically the definition we will adopt. We will make only one trivial 
change, noting that "|* - a\ < 8 and x ^ a" can just as well be expressed 
"0 < \x - a\ < 5." 



DEFINITION 



The function / approaches the limit I near a means : for every £ > 0 there 
is some 8 > 0 such that, for all *, if 0 < |* — a\ < 8, then \ f(x) — l\ < £. 
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This definition is so important (everything we do from now on depends on it) 
that proceeding any further without knowing it is hopeless. If necessary 
memorize it, like a poem! That, at least, is better than stating it incorrectly; 
if you do this you are doomed to give incorrect proofs. A good exercise in 
giving correct proofs is to review every fact already demonstrated about func- 
tions approaching limits, giving real proofs of each. This requires writing 
down the correct definition of what you are proving, but not much more — 
all the algebraic work has been done already. When proving that / does not 
approach / at a, be sure to negate the definition correctly: 

If it is not true that 

for every £ > 0 there is some 6 > 0 such that, for all x, if 0 < \x - a\ < 5, 
then |/0) - /| < e, 



then 

there is some £ > 0 such that for every 5 > 0 there is some x which satisfies 
0 < \x - a\ < d but not \f(x) - /| < £. 

Thus, to show that the function f(x) = sin 1/x does not approach 0 near 0, we 
consider £ = \ and note that for every <5 > 0 there is some x with 0 < |* — 0| 
< 8 but not |sin 1 /x - 0| < i — namely, an x of the form 1/(90 + 36(k), 
where n is so large that 1/(90 + 360n) < 5. 

As an illustration of the use of the definition of a function approaching a 
limit, we have reserved the function shown in Figure 14, a standard example, 
but one of the most complicated: 



fix) 



0, 

Vq, 



x irrational, 0 < x < 1 
x = p/q in lowest terms, 0 < x < 1. 

(Recall that p/q is in lowest terms if p and q are integers with no common 
factor and q > 0.) 



(0, x irrational 
h x = £ in lowest terms 



FIGURE 14 
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For any number a, with 0 < a < 1 , the function / approaches 0 at a. To 
prove this, consider any number £ > 0. Let n be a natural number so large 
that 1 /n < e. Notice that the only numbers x for which \f(x) — 0| < 6 could 
be false are: 

112131234 1 n - 1 

2 ; 3 ? 3 ; 4 4'* 5' 5* s' 5 ; ' ' " ; n ' ' * 9 n 

(If a is rational, then a might be one of these numbers.) However many of 
these numbers there may be, there are, at any rate, only finitely many. There- 
fore, of all these numbers, one is closest to a\ that is, \p/q — a\ is smallest for 
one p/q among these numbers. (If a happens to be one of these numbers, then 
consider only the values \p/q — a\ for p/q ?± a.) This closest distance may be 
chosen as the 5. For if 0 < \x — a\ < 8, then x is not one of 

1 n - 1 



and therefore \f(x) — 0| < £ is true. This completes the proof. Note that our 
description of the <5 which works for a given £ is completely adequate — there 
is no reason why we must give a formula for 8 in terms of £. 

Armed with our definition, we are now prepared to prove our first theorem; 
you have probably assumed the result all along, which is a very reasonable 
thing to do. This theorem is really a test case for our definition: if the theorem 
could not be proved, our definition would be useless. 

THEOREM l A function cannot approach two different limits near a. In other words, if / 
approaches / near a, and / approaches m near a, then / == m. 

PROOF Since this is our first theorem about limits it will certainly be necessary to 
translate the hypotheses according to the definition. 

Since / approaches / near a, we know that for any £ > 0 there is some num- 
ber 8 1 > 0 such that, for all x, 

if 0< |* - a| < 8 h then |/(*) - /| < e. 

We also know, since / approaches m near a, that there is some 8 2 > 0 such 
that, for all x, 

if 0 < |* — a| < 8 2) then |/0) - m\ < e. 

We have had to use two numbers, 8i and 8 2 , since there is no guarantee that 
the 8 which works in one definition will work in the other. But, in fact, it is 
now easy to conclude that for any £ > 0 there is some 8 > 0 such that, for 
all X, 

if 0 < \x - a\ < 8, then \f(x) - /| < 6 and |/0) - m\ < e; 
we simply choose 8 = min(6i, S 2 ). 
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To complete the proof we just have to pick a particular s > 0 for which the 
two conditions 

I/O) - /| < 6 and - m\ < S 

cannot both hold, if / ^ m. The proper choice is suggested by Figure 15. If 
/ ^ m, so that |/ - m\ > 0, we can choose \l - m\/2 as our e. It follows that 
there is a 5 > 0 such that, for all x, 

\l - H 

if 0 < |* - a\ < b, then |/0) " /| < —j— ~ 



and |/0) - m| < " ^ 



z— »o 

limit of f(x) as a: approaches a). This definition is possible only because of 
Theorem 1, which ensures that lim }{x) never has to stand for two different 



2 

This implies that for 0 < \x - a\ < <5 we have 

|/ - m \ = |/ - f(x) + fix) - m\ < \l - /0)l + l/to - «l 

2 2 
= 1/ - m|, 

a contradiction. | 

The number / which / approaches near a is denoted by lim fix) (read: the 

x-*a 

mit of fix) as * appro; 
"heorem 1, which ensui 

numbers. The equation 

lim/0) = I 

x-*a 

has exactly the same meaning as the phrase 

/ approaches / near a. 

The possibility still remains that / does not approach / near a, for any /, so that 
lim fix) = / is false for every number 7. This is usually expressed by saying 

x—*a 

that "lim fix) does not exist." 

x — >a 

Notice that our new notation introduces an extra, utterly irrelevant letter 
x, which could be replaced by /, y, or any other letter which does not already 
appear— the symbols 

lim/O), Hm/(0, lim/0), 

x-+a t-*a V-*a 

all denote precisely the same number, which depends on / and a, and has 
nothing to do with *, f, or y (these letters, in fact, do not denote anything at 
all). A more logical symbol would be something like lim/, but this notation, 

a 

despite its brevity, is so infuriatingly rigid that almost no one has seriously 
tried to use it. The notation lim f(x) is much more useful because a function 



/ often has no simple name, even though it might be possible to express /(*) 
by a simple formula involving x. Thus, the short symbol 

lim (.v 2 + sin x) 

x-*a 

could be paraphrased only by the awkward expression 
lim /, where f(x) = x 2 + sin x. 

a 

Another advantage of the standard symbolism is illustrated by the expres- 
sions 

lim x + J 3 , 

ar— >a 

lim x + t\ 

The first means the number which / approaches near a when 

f(x) = x + t\ for all x; 
the second means the number which / approaches near a when 

/(*) = x + t\ for all t. 

You should have little difficulty (especially if you consult Theorem 2) proving 
that 

lim x + t 3 = a + t\ 

x~*a 

lim x + t 3 = x + a z . 

t->a 

These examples illustrate the main advantage of our notation, which is its 
flexibility. In fact, the notation lim f(x) is so flexible that there is some danger 

x—*a 

of forgetting what it really means. Here is a simple exercise in the use of this 
notation, which will be important later: first interpret precisely, and then 
prove the equality of the expressions 

lim f(x) and lim f(a + h). 

x-*a h-*0 

An important part of this chapter is the proof of a theorem which will 
make it easy to find many limits. The proof depends upon certain properties 
of inequalities and absolute values, hardly surprising when one considers the 
definition of limit. Although these facts have already been stated in Problems 
1-19, 1-20, and 1-21, because of their importance they will be presented once 
again, in the form of a lemma (a lemma is an auxiliary theorem, a result that 
justifies its existence only by virtue of its prominent role in the proof of 
another theorem) . The lemma says, roughly, that if x is close to * 0 , and y is 
close to ^o, then x + y will be close to x 0 + yo, and xy will be close to x 0 yo 3 
and 1/y will be close to l/y 0 . This intuitive statement is much easier to remem- 
ber than the precise estimates of the lemma, and it is not unreasonable to read 
the proof of Theorem 2 first, in order to see just how these estimates are used. 
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LEMMA (1) If 

then 
(2) If 



1* - *o| < | and \y - y 0 \ < |> 



\(x+y)- (x 0 +yo)\ < e. 

'* " * oi K min 0' 27i^f+T)) and b ~ y ° l K 27M L M)' 

\xy — Jfo^ol < S. 
|j -j, 0 | < min^— » —j-y 



then 

(3) If y 0 ^ 0 and 



then y 9± 0 and 

proof (i) |o + j) - Oo + ^ 0 )| = 10 - *o) + (y - yo)\ 



< I* - *„| + \y - yo\ < \ + \ = e. 

(2) Since |* — * 0 | < 1 we have 

Ul — |*o| < \x — *o| < 1, 



so that 
Thus 



W < 1 + |*o|- 
|ry - * 0 )>o| = 1*0 - yo) +yo(x - *o)| 

< \x\ ■ \y - yo\ + \yo\ • I* - *o| 



< (i + M) 



+ M 



2(W + 1) 2(W + D 



< ~ + ~ = s. 
2 2 



(3) We have 



W - M < \y - Jo| < ^ 



so |jy|. > i^ol/2. In particular, jy 0, and 



±<-L. 

\y\ \yo\ 



Thus 



i _ 1 

y y<> 



\y*-y\ < A . _L . = e . | 

M * M l>'o| |>o| 2 
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THEOREM 2 If lim /(*) = / and lim g(x) = m 9 then 

x—* a x—*a 

(1) lim (f + g)(x) =l + m; 

(2) lim" (f-g)(x) -l-m. 

x—+a 

Moreover, if m ^ 0, then 

(3) lim (-) (x) = -• 
x->a \g/ m 

PROOF The hypothesis means that for every e > 0 there are 5 h 8 2 > 0 such that, for 
all x, 

ifO <\x - a\ < 6i, then \f(x) - l\ < e, 
and if 0 < |* — a\ < <5 2 , then \g(x) — m\ < £. 

This means (since, after all, e/2 is also a positive number) that there are 
<5i, 5 2 > 0 such that, for all x, 

i(0 <\x - a\ < 8 h then \f(x) - /| < |, 

and if 0 < |# — <z| < <5 2 , then \g(x) — m\ < -• 

Now let 5 = min(5i, fi 2 ). If 0 < |* - a\ < 8, then 0 < \x - a\ < Si and 
0 < \x — a\ < <5 2 are both true, so both 

I/O) - /| < | and " H < | 

are true. But by part (1) of the lemma this implies that ((/ + g)(x) — 
(I + m)\ < £. This proves (1). 

To prove (2) we proceed similarly, after consulting part (2) of the lemma. 
If £ > 0 there are 5 h 8 2 > 0 such that, for all x, 



if 0 < |* - a\ < S l9 then |/(*) - l\ < min (l, £ \ 

\ 2(|m| + 1)/ 

and if 0 < |* - a\< S a , then - m| < — - 

Again let 6 = min(6i, § 2 ), If 0 < |* — <z| < 8, then 

|/W - /| < min (l, ^^y) and |, W - m\ < 

So, by the lemma, \(f'g)(x) — I ° m\ < £, and this proves (2). 
Finally, if £ > 0 there is a 8 > 0 such that, for all x, 

i i ~ , i / \ i . /\m\ £|m| 2 \ 
if 0 < |* - a\ < 8, then \g(x) - m\ < mm I ^ 2/ 



Limits 85 



But according to part (3) of the lemma this means, first, that g(x) ^ 0, so 
(l/g)(x) makes sense, and second that 



W rn 



< e. 



This proves (3). | 

Using Theorem 2 we can prove, trivially, such facts as 



x* + 7x 5 = a z + la b 

™ x* + 1 " « 2 + r 



without going through the laborious process of finding a 5, given an 6. We 
must begin with 

lim 7 = 7, 



x-*a 

lim 1 = 1, 

x-+a 



lim * = 



a, 



but these are easy to prove directly. If we want to find the 5, however, the 
proof of Theorem 2 amounts to a prescription for doing this. Suppose, to take 
a simpler example, that we want to find a 5 such that, for all x, 

if 0 < |* - a\ < 5, then \x 2 + x - (a 2 + a) I < e. 

Consulting the proof of Theorem 2(1), we see that we must first find 8i 
and 5 % > 0 such that, for all x, 

if 0 < |* - a\ < 8i, then I* 2 - <z 2 | < | 
and if 0 < \x - a\ < <5 2 , then |* - a| < |- 

Since we have already given proofs that lim a: 2 = a 2 and lim x - a, we know 
how to do this: 

•■- mto ( 1 '2(HTi)/ 

Thus we can take 

C ( j ,- 

8 « min(5 i? <5 2 ) = min I mm yi, — - — y, - 




If a 0, the same method can be used to find a 8 > 0 such that, for all x, 



if 0 < |* - a\ < <5, then 



v 2 ^2 



< 6. 



The proof of Theorem 2(3) shows that the second condition will follow if we 
find a 8 > 0 such that, for all x, 

if 0 < |* - a\ < 8, then \x 2 - a 2 \ < min ^£ 

Thus we can take 



6 = min 




2(W + 1) 



Naturally, these complicated expressions for 8 can be simplified considerably, 
after they have been derived. 

One technical detail in the proof of Theorem 2 deserves some discussion. 
In order for Km f(x) to be defined it is, as we know, not necessary for / to be 

x—*a 

defined at a y nor is it necessary for / to be defined at all points x ^ a. However, 
there must be some 8 > 0 such that/(*) is defined for x satisfying 0 < \x — a\ 
< 8; otherwise the clause 

"if 0 <\x - a\ < 8, then \f(x) - l\ < s" 

would make no sense at all, since the symbol f(x) would make no sense for 
some #'s. If / and g are two functions for which the definition makes sense, it is 
easy to see that the same is true for / + g and / * g. But this is not so clear for 
1/g, since 1/g is undefined for x with g(x) = 0. However, this fact gets 
established in the proof of Theorem 2(3). 

There are times when we would like to speak of the limit which / approaches 
at a, even though there is no 8 > 0 such that f(x) is defined for x satisfying 
0 < \x — a\ < 8. For example, we want to distinguish the behavior of the two 
functions shown in Figure 16, even though they are not defined for numbers 
less than a. For the function of Figure 16(a) we write 

lim f{x) = I or lim f(x) = /. 

x— *a + x la 

(The symbols on the left are read: the limit of f(x) as x approaches a from 
above). These "limits from above" are obviously closely related to ordinary 
limits, and the definition is very similar: lim f(x) = / means that for every 

e > 0 there is a 8 > 0 such that, for all a*, 

if 0 < x - a < 8, then \ f(x) - l\ < £. 

(The condition "0 < x — a < 8" is equivalent to "0 < \x - a\ < 8 and 
x > a.") 

"Limits from below" (Figure 17) are defined similarly: lim f(x) — I 



Limits 87 



(or lim f(x) = I) means that for every £ > 0 there is a 5 > 0 such that, for 

x T a 

all x, 

if 0 < a - x < 8, then \f(x) - l\ < S. 

It is quite possible to consider limits from above and below even if / is 
defined for numbers both greater and less than a. Thus, for the function / 
of Figure 13, we have 

lim f(x) = 1 and lim f(x) = — 1. 
It is an easy exercise (Problem 27) to show that lim f(x) exists if and only 

x— *a 

if lim f(x) and lim f{x) both exist and are equal. 

x— >a + x—*a~ 

Like the definitions of limits from above and below, which have been 
smuggled into the text informally ; there are other modifications of the limit 
concept which will be found useful. In Chapter 4 it was claimed that if x is 
large, then sin \/x is close to 0. This assertion is usually written 

lim sin l/# = 0. 



FIGURE 18 

The symbol lim f(x) is read "the limit of f(x) as x approaches <*> or "as x 

x—* » 

becomes infinite," and a limit of the form lim f(x) is often called a limit at in- 
finity. Figure 18 illustrates a general situation where lim f(x) = /. Formally, 

x — * 00 

lim f(x) = I means that for every e > 0 there is a number N such that, for 
all x, 

if x > N, then \ f(x) - l\ < S. 

The analogy with the definition of ordinary limits should be clear: whereas 
the condition "0 < \x — a\ < 5" expresses the fact that x is close to a, the 
condition "x > N" expresses the fact that x is large. 

We have spent so little time on limits from above and below, and at infinity, 
because the general philosophy behind the definitions should be clear if you 
understand the definition of ordinary limits (which are by far the most impor- 
tant) . Many exercises on these definitions are provided in the Problems, which 
also contain several other types of limits which are occasionally useful. 
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Find the following limits. (These limits all follow, after some algebraic 
manipulations, from the various parts of Theorem 2 ; be sure you know 
which ones are used in each case, but don't bother listing them.) 

x 2 — 1 

(i) lim 



(ii) lim 

x—>2 

(iii) lim 



x* - 8 



x - 2 



3 



x->3 X — 2 

x n — v" 

(iv) lim 

x->y x — y 

x n - y n 



(v) lim : 
y-+x x — y 

, ' + h - Va 

(vi) lim 

2. In each of the following cases, find a 8 such that |/(.v) — l\ < £ for all 
# satisfying 0 < \x — a\ < 8. 

(i) /(*) = * 4 ; / = a 4 . 

(ii) /(*) = -;a = 1,/ = 1. 

x 

(iii) /(*) - * 4 + -; a = 1, / = 2. 

(iv) /(*) = — ^ ; = o, / = 0. 

1 + sin 2 x 

(v) f(x) = VH; fl = 0 5 / = 0. 

(vi) /(*) = V*; fl = 1, / = 1. 

3. For each of the functions in Problem 4-15, decide for which numbers a 
the limit lim fix) exists. 

x—>a 

*4. (a) Do the same for each of the functions in Problem 4-17. 

(b) Same problem, if we use infinite decimals ending in a string of 0's 
instead of those ending in a string of 9's. 
5. Suppose the functions / and g have the following property: for all s > 0 
and all x, 

if 0< |* - 2| < sin 2 (^j + 6, then |/(*) - 2\ < 6, 

if 0 < |* - 2\ < e 2 , then \g(x) - 4| < 6. 
For each e > 0 find a 8 > 0 such that, for all x, 
ii) if 0 < \x - 2| < 5, then |/(x) + — 6| < e. 
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(ii) if 0 < \x - 2| < <5, then 

(iii) if 0 < |* - 2\ < 5, then 



f(x)g(x) - 8| < e. 
1 1 



< e. 



(iv) if 0 < |* - 2| < j, then 



< E. 



/to _ i 

£to 2 

6. Give an example of a function / for which the following assertion is 
false: If \f(x) - l\ < e when 0 < |.v - a| < 5, then |/(*) - /| < e/2 
when 0 < |* - a\ < 8/2. 

7. (a) If lim f(x) and lim g(x) do not exist, can lim[/(x) + g(x)] or 

x— >a x—+a x— >a 

lim f(x)g(x) exist? 

x— >a 

(b) If lim f(x) exists and lim [/(#) + g(x)] exists, must lim g(x) exist? 

x— + a x— ► a x— + a 

(c) If lim /to exists and lim g(x) does not exist, can lim [f(x) + g(x)] 

x—*a x— +o x— *a 

exist? 

(d) If lim f(x) exists and lim f(x)g(x) exists, does it follow that lim g(x) 

x— ► o x— ► a i — ► a 

exists? 

8. Prove that lim f(x) = lim f(a + h). (This is mainly an exercise in under- 

x— >a A— *0 

standing what the terms mean.) 

9. (a) Prove that lim /(*) = / if and only if lim[/(^) - /] = 0. (First see 

x — > a x — ► a 

why the assertion is obvious; then provide a rigorous proof. In this 
chapter most problems which ask for proofs should be treated in 
the same way.) 

(b) Prove that lim f(x) = lim f(x). 

x— *a x- a ->0 

(c) Prove that lim /(*) = lim /(* 3 ). 

x— >0 x— »0 

(d) Give an example where lim f(x 2 ) exists, but lim f(x) does not. 

x->0 x^O 

10. Suppose there is a 8 > 0 such that f(x) = g(x) when 0 < \x — a\ < 8. 
Prove that lim f(x) = lim g(x). In other words, lim f(x) depends only 

x— > a x— * a x— + a 

on the values of /(x) for x near a — this fact is often expressed by saying 
that limits are a "local property." (It will clearly help to use 8', or some 
other letter, instead of 8, in the definition of limits.) 

11. (a) Suppose that f(x) < g(x) for all x. Prove that lim f(x) < lim g(x), 

x—ki x—*a 

provided that these limits exist. 

(b) How can the hypotheses be weakened? 

(c) If f(x) < g(x) for all x, does it necessarily follow that lim f(x) < 

x—*a 

lim g(x) ? 

x—*a 

12. Suppose that f(x) < g(x) < h{x) and that lim f(x) = lim h{x). Prove 

x-+a x— >a 

that lim g(x) exists, and that lim g(x) = lim f(x) = lim h(x). (Draw a 

x—*a x— >a x— »a x— >a 

picture!) 
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*13. (a) Prove that if lim /(*)/* = / and b ^ 0, then lim f(bx)/x = bl. 

x—*0 x-+Q 

Hint: Write f(bx)/x = b[f{bx)/bx\ 

(b) What happens if b = 0? 

(c) Part (a) enables us to find lim (sin 2x)/x in terms of lim (sin x)/x. 

x—*Q x—>0 

Find this limit in another way. 

14. (a) Prove that if lim /(*) = /, then lim = |/|. 

x—*a x—*a 

(b) Prove that if lim /(*) = / and lim g(x) = m, then lim max (/,$)(*) 

i— »a x—*a x— »« 

= max(/, /«) and similarly for min. 

15. (a) Prove that lim \/x does not exist, i.e., show that lim \/x = / is 

x— >0 *->0 

false for every number /. 
(b) Prove that lim \/{x — 1) does not exist. 

16. Prove that if lim f(x) = /, then there is a number 5 > 0 and a number 

x-+a 

Af such that \f(x)\ < M if 0 < \x — a\ < d. (What does this mean 
pictoriaily?) Hint: Why does it suffice to prove that / — 1 < f(x) < 
I + 1 for 0 < \x - a\ < 8 ? 

17. Prove that if f{x) = 0 for irrational x and /(*) = 1 for rational x, then 
lim f(x) does not exist for any a. 

x— »o 

*18. Prove that if }{x) = x for rational *, and f(x) = -x for irrational x, 
then lim/W does not exist if a ^ 0. 

x— »a 

19. (a) Prove that if lim g(x) = 0, then lim g(x) sin 1 A = 0. 

z— >0 x-»0 

(b) Generalize this fact as follows : If lim g (x) = 0and|AW| < M for all 

z-+ 0 

a-, then lim g(x)h(x) = 0. (Naturally it is unnecessary to do part (a) if 

you succeed in doing part (b); actually the statement of part 
(b) may make it easier than (a) — that's one of the values of 
generalization.) 

20. Consider a function / with the following property: if g is any func- 
tion for which lim g(x) does not exist, then lim[/(x) + g(x)] also does 

not exist. Prove that this happens if and only if lim f(x) does exist. Hint: 

This is actually very easy: the assumption that lim f(x) does not exist 

leads to an immediate contradiction if you consider the right g. 
**21. This problem is the analogue of Problem 20 when / + g is replaced by 
/ • g. In this case the situation is considerably more complex, and the 
analysis requires several steps (those in search of an especially challeng- 
ing problem can attempt an independent solution) . 

(a) Suppose that lim f(x) exists and is ^ 0. Prove that if lim g(x) does 
not exist, then lim f(x)g(x) also does not exist. 

x-+0 
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(b) Prove the same result if lim \f{x)\ = <*>. (The precise definition of 

this sort of limit is given in Problem 33.) 

(c) Prove that if neither of these two conditions holds, then there is a 
function g such that lim g(x) does not exist, but lim f(x)g(x) does 

exist. Hint: Consider separately the following two cases: (1) For 
some e > 0 we have |/(*)| > £ for all sufficiently small x. (2) For 
every 6 > 0, there are arbitrarily small x with |/(*)| < £. In the 
second case, begin by choosing points x n with \x n \ < 1/n and 
\f(x n )\<l/n. 

*22. Suppose that A n is, for each natural number n, some finite set of numbers 
in [0, 1], and that A n and A m have no members in common if m 5* n. 
Define / as follows: 

f(x) = ( X l n > xin An 

\ 0, x not in A n for any n. 

Prove that lim /(*) = 0 for all a in [0, 1]. 

x-+a 

23. Explain why the following definitions of lim f(x) = / are all correct: 

x—*a 

For every 8 > 0 there is an £ > 0 such that, for all x, 

(i) if 0 < i* - a\ < e, then \f(x) ~ /| < 5. 

(ii) if 0 < I* - a\ < s, then \f{x) - l\ < 8. 

(iii) if 0 < I* - a\ < e, then |/(at) - /| < 56. 

(iv) if 0 < I* - a\ < e/10, then |/(*) - /| < «. 

*24. Give examples to show that the following definitions of lim f(x) = I are 

x—*a 

not correct. 

(a) For all 8 > 0 there is an £ > 0 such that if 0 < \x — a\ < 5, then 

l/W - /I < e. 

(b) For all £ > 0 there is a 6 > 0 such that if |/(*) — l\ < £, then 
0 < I* - a\ < 8. 

25. For each of the functions in Problem 4-15 indicate for which numbers a 
the one-sided limits lim f(x) and lim f(x) exist. 

x—*a + x—*a~ 

*26. (a) Do the same for each of the functions in Problem 4-17. 

(b) Also consider what happens if decimals ending in 0's are used 
instead of decimals ending in 9's. 

27. Prove that lim f(x) exists if lim /(*) = lim /(*). 

x~*a x~*a + x-*a~ 

28. Prove that 

(i) lim f(x) = lim /(-*). 

(ii) lim /(H) = lim/(x). 

x~»0 x-*0+ 



(iii) lim f(x 2 ) = lim /(*). 

x->0 x-»0+ 

(These equations, and others like them, are open to several interpreta- 
tions. They might mean only that the two limits are equal if they both 
exist; or that if a certain one of the limits exists, the other also exists and 
is equal to it; or that if either limit exists, then the other exists and is 
equal to it. Decide for yourself which interpretations are suitable.) 
*29. Suppose that lim f(x) < lim /(*). (Draw a picture to illustrate this 

assertion.) Prove that there is some 8 > 0 such that f(x) < f(y) when- 
ever x < a < y and \x — a\ < 8 and \y — a\ < 8. Is the converse true? 
*30. Prove that lim (a n x n + • • • + a 0 )/(b m x m + • • • + b 0 ) exists if and 

x — ► 00 

only if m > n. What is the limit when m = n? When m > n? Hint: The 
one easy limit is lim l/x k = 0; do some algebra so that this is the only 

X — > oo 

information you need. 

31. Prove that lim f(l/x) = lim /(*). 

x — » 0 + x—* oo 

32. Define " lim /(*) = /." 

X— > — oo 

(a) Find lim (a n x n + • • ■ + a 0 )/(b m x m + • * • + b 0 ). 

X—* — 00 

(b) Prove that lim /( x) = lim f(-x). 

X—+ oo x — ► — oo 

(c) Prove that lim f(\/x) = lim f(x). 

x— x— ► — oo 

33. We define lim f(x) = « to mean that for all N there is a 8 > 0 such 

x—*a 

that, for all x, if 0 < \x — a\ < 8, then f(x) > N. (Draw an appropriate 
picture!) 

(a) Show that lim \/{x - 3) 2 = oo. 

x-»3 

(b) Prove that if /(*) > £ > 0 for all x, and lim g(x) = 0, then 

X—Kl 

\imf(x)/g(x) = oo. 



34. (a) Define lim f(x) = oo ; lim f(x) = oo, and lim f(x) = oo. (Or at 

x—*a + x-+a~ x— + oo 

least convince yourself that you could write down the definitions if 
you had the energy. How many other such symbols can you define?) 

(b) Prove that lim 1/x = oo. 

(c) Prove that lim f(x) = oo if and only if lim f(\/x) = oo. 

x->0 + x~+ 00 
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CONTINUOUS FUNCTIONS 



If / is an arbitrary function, it is not necessarily true that 

lim/W =/(*). 

x-*a 

In fact, there are many ways this can fail to be true. For example, / might not 
even be defined at a, in which case the equation makes no sense (Figure 1). 
Again, lim f(x) might not exist (Figure 2). Finally, as illustrated in Figure 

x — *tt 

3, even if / is defined at a and lim f(x) exists, the limit might not equal f(a). 



DEFINITION 



-A 




(a) 

FIGURE 2 



(b) 



(c) 



We would like to regard all behavior of this type as abnormal and honor, 
with some complimentary designation, functions which do not exhibit such 
peculiarities. The term which has been adopted is "continuous." Intuitively, 
a function / is continuous if the graph contains no breaks, jumps, or wild 
oscillations. Although this description will usually enable you to decide 
whether a function is continuous simply by looking at its graph (a skill well 
worth cultivating) it is easy to be fooled, and the precise definition is very 
important. 



The function / is continuous at a if 

lim/(*) = /(„). 



We will have no difficulty finding many examples of functions which are, 
or are not, continuous at some number a — every example involving limits 
provides an example about continuity, and Chapter 5 certainly provides 
enough of these. 

The function f(x) = sin 1/x is not continuous at 0, because it is not even 
defined at 0, and the same is true of the function g(x) — x sin 1/x. On the 
other hand, if we are willing to extend the second of these functions, that is, if 
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FIGURE 4 



we wish to define a new function G by 

G(x) = (*sinlA, 



^0 
x = 0, 



then the choice of a = G(0) can be made in such a way that G will be con- 
tinuous at 0 — to do this we can (in fact, we must) define G(0) = 0 (Figure 4). 
This sort of extension is not possible for /; if we define 



F{x) 



sin 1/x, x 0 
a, x = 0, 



then F will not be continuous at 0, no matter what a is, because lim f(x) does 

x-*0 

not exist. 

The function 



f( \ _ | x i x ratioi 
J \ 0, x irrati 



rational 
rrational 



is not continuous at a, if a 0, since lim f(x) does not exist. However, 

x— »a 

lim f(x) = 0 = /(0), so / is continuous at precisely one point, 0. 

x— >0 

The functions /(*) = c, g(x) = *, and = x 2 are continuous at all 
numbers a, since 

lim f(x) = lim c — c = f(a), 

x—*a x—>a 

lim g(x) = lim x — a — g(a), 

x—>a x — * a 

lim A(*) — lim x 2 = a 2 = h{a). 



Finally, consider the function 

f( \ — \ 0> x irration 
}W ~ \ l/q, x=p/qi 



irrational 

in lowest terms. 



In Chapter 5 we showed that lim f(x) = 0 for all a. Since 0 = }(a) only when 

x—*a 

a is irrational, this function is continuous at a if a is irrational, but not if a is 
rational. 

It is even easier to give examples of continuity if we prove two simple 
theorems. 

THEOREM l If / and g are continuous at a, then 

(1) / + g i s continuous at a, 

(2) f • g is continuous at a. 



Moreover, if g(a) ^ 0, then 



(3) 1/g is continuous at a. 
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PROOF 



THEOREM 2 



PROOF 



Since / and g are continuous at a, 

lim/O) = f(a) and lim g(x) = g(a). 

By Theorem 2(1) of Chapter 5 this implies that 

lim (/ + g)(x) = }{a) +g{a) = (/ + 

which is just the assertion that / + g is continuous at a. The proofs of parts 
(2) and (3) are left to you. | 

Starting with the functions /(*) = e and /(*) = *, which are continuous 
at a, for every a, we can use Theorem 1 to conclude that a function 



/(*) = 



b„x n + fen-i*" -1 + • • • + b 0 



C X 



+ c 0 



is continuous at every point in its domain. But it is harder to get much further 
than that. When we discuss the sine function in detail it will be easy to prove 
that sin is continuous at a for all a; let us assume this fact meanwhile. A func- 
tion like 

_ sin 2 x + x 2 + x 4 sin x 
f{x) " ' sin 27 x + 4x 2 sin 2 x 
can now be proved continuous at every point in its domain. But we are 
still unable to prove the continuity of a function like /(*) - sin(* ); we 
obviously need a theorem about the composition of continuous functions. 
Before stating this theorem, the following point about the definition of con- 
tinuity is worth noting. If we translate the equation Urn f(x) = f(a) according 

to the definition of limits, we obtain 

for every e > 0 there is <5 > 0 such that, for all x, 

if 0 < |* - a\ < d, then |/(*) - f(a)\ < e.- 

But in this case, where the limit is f(a), the phrase 

0 <\x - a\ < d 
may be changed to the simpler condition 

\x - a\ < 5, 

since if x = a it is certainly true that \f(x) - f(a)\ < e. 

Ug is continuous at a, and / is continuous at g(a), then / o g is continuous at a. 
(Notice that / is required to be continuous at g(a), not at a.) 

Let £ > 0. We wish to find a S > 0 such that for all x, 

if |* -a\<5, then \(fog)(x) - (f ° g)(a)\ < e, 
i.e., |/UW) < 2. 



We first use continuity of / to estimate how close g(x) must be to g(a) in order 
for this inequality to hold. Since /is continuous atg(a), there is a <5' > 0 such 
that for all y, 

(1) if \y - g(a)\ < 8', then \f(y) - f(g(a))\ < e. 

In particular, this means that 

(2) if \g(x) - g(a)\ < 6', then \f(g(x)) - f(g(a))\ < e. 

We now use continuity of g to estimate how close x must be to a in order for 
the inequality \g{x) — g(a)\ < 8' to hold. The number 8 f is a positive number 
just like any other positive number; we can therefore take 8' as the £ (!) in the 
definition of continuity of g at a. We conclude that there is a 8 > 0 such that, 
for all x, 

(3) if \x - a\ < <5, then \g(x) - g(a)\ < 8'. 
Combining (2) and (3) we see that for all x } 

if \x-a\< 8, then \f(g(x)) - f(g(a))\ < S. | 



We can now reconsider the function 

,/ x _ I x sin 1 /x, x 0 
m ~ \ 0, x = 0. 

We have already noted that / is continuous at 0. A few applications of 
Theorems 1 and 2, together with the continuity of sin, show that / is also con- 
tinuous at a, for a ^ 0. Functions like f(x) = sin(* 2 + sin(* + sin 2 (# 3 ))) 
should be equally easy for you to analyze. 

The few theorems of this chapter have all been related to continuity of 
functions at a single point, but the concept of continuity doesn't begin to be 
really interesting until we focus our attention on functions which are continu- 
ous at all points of some interval. If /is continuous at x for all x in (a, b), then/ 
is called continuous on (a, b). Continuity on a closed interval must be defined 
a little differently; a function / is called continuous on [a, b] if 

(1) /is continuous at x for all x in (a, b), 

(2) lim f(x) = f(a) and lim f(x) = f(b). 

x—*a + £— >&~ 



Functions which are continuous on an interval are usually regarded as 
especially well behaved; indeed continuity might be specified as the first 
condition which a "reasonable" function ought to satisfy. A continuous func- 
tion is sometimes described, intuitively, as one whose graph can be drawn 
without lifting your pencil from the paper. Consideration of the function 

f (v \ _ | x sin \/x, x 0 
/W i 0, x = 0 
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shows that this description is a little too optimistic, but it is nevertheless true 
that there are many important results involving functions which are continu- 
ous on an interval. These theorems are generally much harder than the ones in 
this chapter, but there is a simple theorem which forms a bridge between the 
two kinds of results. The hypothesis of this theorem requires continuity at only 
a single point, but the conclusion describes the behavior of the function on 
some interval containing the point. Although this theorem is really a lemma 
for later arguments, it is included here as a preview of things to come. 

THEOREM 3 Suppose /is continuous at a, and f(a) > 0. Then there is a number 8 > 0 such 
that /(*) > 0 for all x satisfying \x - a\ < 8. Similarly, if f(a) < 0, then there 
is a number 8 > 0 such that f(x) < 0 for all x satisfying \x — a\ < 8. 

PROOF Consider the case f(a) > 0. Since/ is continuous at <z, if s > 0 there is a 8 > 0 
such that, for all x, 

if \x - a\ < 8, then \f(x) - f(a)\ < £. 

Since f(a) > 0 we can take f(a) as the e. Thus there is 8 > 0 so that for all x, 

if\x-a\ < 8 y then )/(*) ~ f(a)\ < /(a), 

and this last inequality implies f(x) > 0. 

A similar proof can be given in the case f(a) < 0; take £ = —/(a). Or one 
can apply the first case to the function —/. | 

PROBLEMS 

1. For which of the following functions / is there a continuous function F 
with domain R such that F(x) = f(x) for all x in the domain of/? 



(i) fix) = 




(ii) f(x) = 

X 

(iii) f{x) = 0, x irrational. 

(iv) fix) - \/q, x = p/q rational in lowest terms. 

2. At which points are the functions of Problems 4-1 5 and 4-17 continuous? 

3. (a) Suppose that / is a function satisfying \f(x) | < |*| for all x. Show that 

/ is continuous at 0. (Notice that /(0) must equal 0.) 

(b) Give an example of such a function / which is not continuous at any 
a ^ 0. 

(c) Suppose that g is continuous at 0 and g(0) = 0, and |/(*)| < \g(x)\. 
Prove that / is continuous at 0. 

4. Give an example of a function / such that / is continuous nowhere, but 
| /| is continuous everywhere. 
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5. For each number 0, find a function which is continuous at a, but not at 
any other points. 

6. (a) Find a function / which is discontinuous at 1, ■£■,. . . . but con- 

tinuous at all other points, 
(b) Find a function / which is discontinuous at 1 , ■£-, J, . . . , and 
at 0, but continuous at all other points. 

7. Suppose that /satisfies f(x + y) = f(x) + f(y), and that / is continuous 
at 0. Prove that / is continuous at a for all a. 

8. Suppose that / is continuous at a and f(a) = 0. Prove that if a 9* 0, then 
/ + a is nonzero in some open interval containing a. 

9. (a) Suppose / is not continuous at a. Prove that for some number £ > 0 

there are numbers x arbitrarily close to a with \f(x) — f(a) \ > 6. 
Illustrate graphically, 
(b) Conclude that for some number £ > 0 either there are numbers x 
arbitrarily close to a with f(x) < f(a) — £ or there are numbers x 
arbitrarily close to a with f(x) > f(a) + £. 

10. (a) Prove that if / is continuous at a, then so is |/[ 

(b) Prove that every continuous / can be written / = .E + 0, where E is 
even and continuous and 0 is odd and continuous. 

(c) Prove that if / and g are continuous, then so are max(/, g) and 
min(/, g). 

(d) Prove that every continuous / can be written / = g — h, where g and 
h are nonnegative and continuous. 

11. Prove Theorem 1 (3) by using Theorem 2 and continuity of the function 
f(x) = l/x. 

*12. (a) Prove that if /is continuous at / and lim g(x) = L then lim f(g(x)) = 

x—*a x—*a 

/(/). (You can go right back to the definitions, but it is easier to con- 
sider the function G with G(x) = g(x) for x ^ a, and G(a) = L) 
(b) Show that if continuity of / at / is not assumed, then it is not gener- 
ally true that lim f(g{x)) = /(lim g{x)). Hint: Try /(*) = 0 for 

x— *a x— m 

x^l, and/(/) = 1. 

13. (a) Prove that if / is continuous on [a, b\ then there is a function g which 

is continuous on R, and which satisfies g(x) = f(x) for all x in [a, b\ 
Hint: Since you obviously have a great deal of choice, try making g 
constant on (— <x> 5 a] and [b, 00). 
(b) Give an example to show that this assertion is false if [a, b] is replaced 
by (a, b). 

14. (a) Suppose that g and h are continuous at a, and that g{a) = h (a). 

Define f(x) to be g(x) if x > a and h(x) if x < a. Prove that / is con- 
tinuous at a. 

(b) Suppose g is continuous on [a, b] and h is continuous on [b 9 c] and 
g(b) — h(b). Let f(x) be g(x) for x in [a, b] and h(x) for x in [b, c]. 
Show that / is continuous on [a, c]. (Thus, continuous functions can 
be "pasted together.") 
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15. (a) Prove the following version of Theorem 3 for " right-hand conti- 

nuity'': Suppose that lim f(x) = fia), and f(a) > 0. Then there is a 

x—*a + 

number 6 > 0 such that fix) > 0 for all x satisfying 0 < x — a < d. 
Similarly, if fia) < 0, then there is a number 8 > 0 such that 
fix) < 0 for all x satisfying 0 < x — a < 6. 
(b) Prove a version of Theorem 3 when lim fix) = fib). 

x—>b~ 

16. If lim fix) exists, but is ^ fia), then / is said to have a removable 

x— *a 

discontinuity at a. 

(a) If fix) = sin 1 /x for # ^ 0 and /(0) = 1 , does / have a removable 
discontinuity at 0? What if fix) = x sin 1 fx for * ^ 0, and /(0) = 1? 

(b) Suppose / has a removable discontinuity at a. Let gix) = /(*) for 
* a, and let = lim/(x). Prove that g is continuous at a. 

x— »o 

(Don't work very hard; this is quite easy.) 

(c) Let /(*) = 0 if a: is irrational, and let fip/q) = l/q if p/q is in lowest 
terms. What is the function g defined by gix) = lim f(y)? 

y—*x 

*(d) Let / be a function with the property that every point of discontinu- 
ity is a removable discontinuity. This means that lim fiy) exists for 

y— *x 

all x, but / may be discontinuous at some (even infinitely many) 
numbers x. Define gix) = lim fiy). Prove that g is continuous. (This 

is not quite so easy as part (b).) 
**(e) Is there a function / which is discontinuous at every point, and which 
has only removable discontinuities? (It is worth thinking about this 
problem now, but mainly as a test of intuition; even if you suspect 
the correct answer, you will almost certainly be unable to prove it 
at the present time. See Problem 21-24.) 
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This chapter is devoted to three theorems about continuous functions, and 
some of their consequences. The proofs of the three theorems themselves will 
not be given until the next chapter, for reasons which are explained at the end 
of this chapter. 

If / is continuous on [a, b] and f(a) < 0 < f(b), then there is some x in [a, b] 
such that /(*) - 0. 

(Geometrically, this means that the graph of a continuous function which 
starts below the horizontal axis and ends above it must cross this axis at some 
pointy as in Figure 1.) 

If/ is continuous on [a, b], then /is bounded above on [a, b], that is, there is 
some number N such that /(*) < N for all x in [a, b]. 

(Geometrically, this theorem means that the graph of / lies below some line 
parallel to the horizontal axis, as in Figure 2). 

If / is continuous on [a, b], then there is some number y in [a, b] such that 
f(y) >/(*) for all x in [a, b] (Figure 3). 

These three theorems differ markedly from the theorems of Chapter 6. The 
hypotheses of those theorems always involved continuity at a single point, 




THEOREM 1 



THEOREM 2 



THEOREM 3 
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FIGURE 6 



while the hypotheses of the present theorems require continuity on a whole 
interval [a, £]— if continuity fails to hold at a single point, the conclusions 
may fail. For example, let / be the function shown in Figure 4, 



/M 



0-<x<V2 
V2 < x < 2. 



Then / is continuous at every point of [0, 2] except V2, and/(0) < 0 < f(2), 
but there is no point x in [0, 2] such that /(*) - 0; the discontinuity at the 
single point V 2 is sufficient to destroy the conclusion of Theorem 1 . 
Similarly, suppose that / is the function shown in Figure 5, 



/(*) 



0, 



x ^ 0 
x = 0. 



Then / is continuous at every point of [0, 1] except 0, but / is not bounded 
above on [0, 1], In fact for any number N > 0, we have f(£$) = 2N > N. 

This example also shows that the closed interval [a, b] in Theorem 2 cannot 
be replaced by the open interval (a, b), for the function /is continuous on (0, 1), 
but is not bounded there. 

Finally, consider the function shown in Figure 6, 



/« " 



x\ 
0, 



x < 1 

x > 1. 



On the interval [0, 1] the function / is bounded above, so / does satisfy the 
conclusion of Theorem 2, even though / is not continuous on [0, 1]. But / does 
not satisfy the conclusion of Theorem 3— there is no y in [0, 1] such that 
/GO > fix) for all x in [0,1]; in fact, it is certainly not true that/(l) > /(*) for 
all x in [0, 1] so we cannot choosey = 1, nor can we choose 0 < y < 1 because 
f{y) < f(x) if x is any number with y < x < 1 . 

This example shows that Theorem 3 is considerably stronger than Theorem 
2. Theorem 3 is often paraphrased by saying that a continuous function on 
a closed interval "takes on its maximum value" on that interval. 

As a compensation for the stringency of the hypotheses of our three theorems, 
the conclusions are of a totally different order than those of previous theorems. 
They describe the behavior of a function, not just near a point, but on a whole 
interval; such "global" properties of a function are always significantly more 
difficult to prove than "local" properties, and are correspondingly of much 
greater power. To illustrate the usefulness of Theorems 1, 2, and 3, we will 
soon deduce some important consequences, but it will help to first mention 
some simple generalizations of these theorems. 



THEOREM 4 If / is continuous on [a, b] and f{a) < c < fib), then there is some x in [a, b] 
such that fix) = c. 



PROOF Let g = f — c. Then g is continuous, and g(a) < 0 < gib). By Theorem 1, 
there is some x in [a, b] such that g{x) = 0. But this means that /(*) = c. | 

THEOREM 5 If / i s continuous on [a, ' b] and /(a) > c > fib), then there is some x in [a, b] 
such that /(at) = c. 

PROOF The function — / is continuous on [a, b] and —f(a) < —c < —f(b). By 
Theorem 4 there is some x in [a, b] such that —f(x) = — c, which means 
that f(x) = c. | 

Theorems 4 and 5 together show that / takes on any value between f{a) and 
f(b). We can do even better than this: if c and d are in [a, b], then / takes on 
any value between f(c) and fid). The proof is simple; if, for example, c < d, 
then just apply Theorems 4 and 5 to the interval [c, d]. Summarizing, if a 
continuous function on an interval takes on two values, it takes on every value 
in between; this slight generalization of Theorem 1 is often called the Inter- 
mediate Value Theorem. 



THEOREM 6 



PROOF 



THEOREM 7 



PROOF 



If / is continuous on [a, b], then / is bounded below on [a, b\ that is, there is 
some number TV such that f(x) > N for all x in [a, b]. 

The function — / is continuous on [a, b], so by Theorem 2 there is a number M 
such that -/(*) < M for all x in [a, b]. But this means that /(*)" > -AT for all 
x in [a, b\ so we can let N = — M. | 

Theorems 2 and 6 together show that a continuous function / on [a, b] is 
bounded on [a, b], that is, there is a number N such that \f{x) \ < N for all x in 
[a, b]. In fact, since Theorem 2 ensures the existence of a number Ni such that 
f{x) < Ni for all x in [a, 6], and Theorem 6 ensures the existence of a number 
N 2 such that fix) > N 2 for all x in [a, b], we can take N = max(|#i|, \N 2 \). 

If /is continuous on [a, b], then there is somejy in [a, b] such that/(j) < /W 
for all x in [a, b]. 

(A continuous function on a closed interval takes on its minimum value on 
that interval.) 

The function —/is continuous on [a, b] \ by Theorem 3 there is some; in [a, b] 
such that — fiy) > —fix) for all x in [a, b], which means that f(y) < fix) for 
all x in b\ | 

Now that we have derived the trivial consequences of Theorems 1, 2, and 3, 
we can begin proving a few interesting things. 



THEOREM 8 



Every positive number has a square root. In other words, if a > 0, then there 
is some number x such that x 2 = a. 
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PROOF 



Consider the function /(*) = * 2 , which is certainly continuous. Notice that 
the statement of the theorem can be expressed in terms of/: "the number a 
has a square root" means that / takes on the value a. The proof of this fact 
about / will be an easy consequence of Theorem 4. 

There is obviously a number b > 0 such that f(b) > a (as illustrated in 
Figure 7); in fact, if a > 1 we can take b = a, while if a < 1 we can take 
b = 1. Since /(0) < a < f(b) y Theorem 4 applied to [0, b] implies that for 
some x (in [Q, b]), we have /(*) = a, i.e., x 2 = a. | 

Precisely the same argument can be used to prove that a positive number has 
an nth root, for any natural number n. If n happens to be odd, one can do 
better: every number has an nth root. To prove this we just note that if the posi- 
tive number a has the nth root *. i.e., if x n = a, then ( — x) n = —a (since n is 
odd), so —a has the nth root —x. The assertion, that for odd n any number a 
has an nth root, is equivalent to the statement that the equation 

x n - a = 0 

has a root if n is odd. Expressed in this way the result is susceptible of great 
generalization. 



THEOREM 9 If n is odd, then any equation 

x n + a n ^x n ~ l + 

has a root. 



+ a 0 - 0 



PROOF We obviously want to consider the function 

fix) = x n + a n ^ 1 x n ~ 1 + 



we would like to prove that / is sometimes positive and sometimes negative. 
The intuitive idea is that for large \x\, the function is very much like g(x) = x n 
and, since n is odd, this function is positive for large positive x and negative for 
large negative x. A little algebra is all we need to make this intuitive idea work. 
The proper analysis of the function / depends on writing 



fix) = x n + a n ^x n ~ 
Note that 



< 



Consequently, if we choose x satisfying 

(*) |*| > 1, 2n|a n _i|, 

then |**| > |*| and 



\a n -k\ |gn-fc| < 



|**| 



|*| 2n\a n - k \ 



[ + • • 
5 2w|a 0 | : 
2^ 5 



+ 



Igoj 
l* n l 





1_ 

2 



x n 2n In 



n terms 



In other words, 





which implies that 




Therefore, if we choose an *i > 0 which satisfies (*), then 



2 \ xi x n / 



so that f(xi) > 0. On the other hand, if x 2 < 0 satisfies (*), then x 2 n < 0 and 



so that f(x 2 ) < 0. 

Now applying Theorem 1 to the interval [x 2 , x{] we conclude that there is 
an x in [x 2 , x t ] such that /(*) «= 0. | 

Theorem 9 disposes of the problem of odd degree equations so happily that 
it would be frustrating to leave the problem of even degree equations com- 
pletely undiscussed. At first sight, however, the problem seems insuperable. 
Some equations, like x 2 — 1 = 0, have a solution, and some, like x 2 + 1 =0, 
do not — what more is there to say? If we are willing to consider a more general 
question, however, something interesting can be said. Instead of trying to solve 
the equation 

x n + a n -ix n - 1 + • • ; + a 0 « 0, 

let us ask about the possibility of solving the equations 

x n + an^x^ 1 + • • • + a 0 = c 

for all possible numbers c. This amounts to allowing the constant term a 0 to 
vary. The information which can be given concerning the solution of these 
equations depends on a fact which is illustrated in Figure 8. 

The graph of the function /(*) = x n + an-ix 71 ^ 1 + • • • + a 0 , with n even, 
contains, at least the way we have drawn it, a lowest point. In other words, 
there is a number y such that f(y) < f(x) for all numbers x — the function / 
takes on a minimum value, not just on each closed interval, but on the whole 
line. (Notice that this is false if n is odd.) The proof depends on Theorem 7, but 
a tricky application will be required. We can apply Theorem 7 to any interval 




\ X 2 * 2 / 
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[a, ft], and obtain a point y 0 such that f(y 0 ) is the minimum value of/ on [a, 6]; 
but if [a, ft] happens to be the interval shown in Figure 8, for example, then 
the point y 0 will not be the place where / has its minimum value for the whole 
line. In the next theorem the entire point of the proof is to choose an interval 
[a> ft] in such a way that this cannot happen. 



THEOREM io If n is even and f(x) = x n + <2 n -i* n_1 + 
such that f(y) < f(x) for all x. 

PROOF As in the proof of Theorem 9, if 

M — max(l, 2«|<2 n _i| 
then for all x with |x| > M, we have 

!<!+— + 
2 x 

Since n is even, x n > 0 for all x, so 
2 ~ \ x 



+ <z o, then there is a number y 



, 2n|fl 0 |), 



x n 



?)-/<->. 



provided that |^| > Af. Now consider the number /(0). Let ft > 0 be a number 
such that b n > 2/(0) and also b > M. Then, if * > ft, we have (Figure 9) 



x n b n 

fix) >|>y >/(0). 

Similarly, if x < —ft, then 
Summarizing: 

if ^ > ft or * < -ft, then /(*) > /(0). 

Now apply Theorem 7 to the function /on the interval [ — ft, ft]. We con- 
clude that there is a number y such that 

(1) if -ft < x < ft, then /GO < /(at). 

In particular, f(y) < /(0). Thus 

(2) if x < -ft or x > ft, then /(*) > /(0) > /(>). 

Combining (1) and (2) we see that f(y) < f(x) for all x. | 

Theorem 10 now allows us to prove the following result. 



THEOREM 11 Consider the equation 

(*) X n + dn^x"- 1 + 



+ ao = c, 
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PROOF 




FIGURE 10 




FIGURE 11 



and suppose n is even. Then there is a number m such that (*) has a solution 
for c > m and has no solution for c < m. 



Let /(*) = x n + an-ix*- 1 + 



+ a 0 (Figure 10). 



According to Theorem 1 0 there is a number y such that f(y) < f(x) for all 
x. Let m — /(>')• If c < m, then the equation (*) obviously has no solution, 
since the left side always has a value > m. If c — m, then (*) has y as a solu- 
tion. Finally, suppose c > m. Let b be a number such that b > y and f(b) > c. 
Then f(y) = m < c < f(b) . Consequently, by Theorem 4, there is some num- 
ber x in [y, b] such that f(x) = c, so x is a solution of (*). | 

These consequences of Theorems 1,2, and 3 are the only ones we will derive 
now (these theorems will play a fundamental role in everything we do later, 
however). Only one task remains — to prove Theorems 1, 2, and 3. Unfortu- 
nately, we cannot hope to do this — on the basis of our present knowledge 
about the real numbers (namely, PI -PI 2) a proof is impossible. There are 
several ways of convincing ourselves that this gloomy conclusion is actually the 
case. For example, the proof of Theorem 8 relies only on the proof of Theorem 
1 ; if we could prove Theorem 1, then the proof of Theorem 8 would be com- 
plete, and we would have a proof that every positive number has a square root. 
As pointed out in Part I, it is impossible to prove this on the basis of PI -PI 2. 
Again, suppose we consider the function 



1 



x 2 - 2 



If there were no number x with x 2 = 2, then / would be continuous, since the 
denominator would never = 0. But /is not bounded on [0, 2]. So Theorem 2 
depends essentially on the existence of numbers other than rational numbers, 
and therefore on some property of the reals other than PI -PI 2. 

Despite our inability to prove Theorems 1, 2, and 3, they are certainly 
results which we want to be true. If the pictures we have been drawing have 
any connection with the mathematics we are doing, if our notion of continuous 
function corresponds to any degree with our intuitive notion, Theorems 1, 2, 
and 3 have got to be true. Since a proof of any of these theorems must require 
some new property of R which has so far been overlooked, our present diffi- 
culties suggest a way to discover that property: let us try to construct a 
proof of Theorem 1, for example, and see what goes wrong. 

One idea which seems promising is to locate the first point where f(x) = 0, 
that is, the smallest x in [a, b] such that /(*) = 0. To find this point, first con- 
sider the set A which contains all numbers x in [a, b] such that / is negative on 
[a, x]. In Figure 1 1 , x is such a point, while x' is not. The set A itself is indicated 
by a heavy line. Since / is negative at <2, and positive at b, the set A contains 
some points greater than a, while all points sufficiently close to b are not in A. 
(We are here using the continuity of /on [a, b] 9 as well as Problem 6-15.) 
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fix) < 0 for all x in this interval 




A would also contain 
all these points 



FIGURE 12 




f{x) > 0 for all x 
in this interval 



FIGURE 13 



Now suppose a is the smallest number which is greater than all members of 
A; clearly a < a < b. We claim that /(a) = 0, and to prove this we only have 
to eliminate the possibilities f(a) < 0 and /(a) > 0. 

Suppose first that /(a) < 0. Then, by Theorem 6-3, /(*) would be less than 
0 for all x in a small interval containing a, in particular for some numbers 
bigger than a (Figure 12); but this contradicts the fact that a is bigger than 
every member of A, since the larger numbers would also be in A. Consequently, 
/(a) < 0 is false. 

On the other hand, suppose /(a) > 0. Again applying Theorem 6-3, we 
see that f(x) would be positive for all a: in a small interval containing a, in 
particular for some numbers smaller than a (Figure 13). This means that these 
smaller numbers are all not in A. Consequently, one could have chosen an 
even smaller a which would be greater than all members of A. Once again we 
have a contradiction; f(a) > 0 is also false. Hence f(a) = 0 and, we are 
tempted to say, Q.E.D. 

We know, however, that something must be wrong, since no new properties 
or R were ever used, and it does not require much scrutiny to find the dubious 
point. It is clear that we can choose a number a which is greater than all 
members of A (for example, we can choose a = b), but it is not so clear that 
we can choose a smallest one. In fact, suppose A consists of all numbers x > 0 
such that x 2 < 2. If the number V 2 did not exist, there would not be a least 
number greater than all the members of A ; for any y > V2 we chose, we could 
always choose a still smaller one. 

Now that we have discovered the fallacy, it is almost obvious what addi- 
tional property of the real numbers we need. All we must do is say it properly 
and use it. That is the business of the next chapter. 

PROBLEMS 

1. For each of the following functions, decide which are bounded above or 
below on the indicated interval, and which take on their maximum or 
minimum value. (Notice that/ might have these properties even if/ is not 
continuous, and even if the interval is not a closed interval.) 

(i) /(*) = on (-1, 1). 

(ii) f(x) = x* on (-1, 1). 

(iii) f(x) = x 2 on R. 

(iv) /(*) = x 2 on [0, 00). 

sary to consider several possibilities for a.) 



x - a on {-a - 1, a + 1). (It will be neces- 
x > a 



sf \ f # irrational rn in 

(via) f(x) = \ 9 . on [0, 1]. 

( 1 /£, x = in lowest terms 

/•x r, v f 1, x irrational rrk 

(ix) /(*) = { # on [0, 1]. 

I -i/q, x = p/q m lowest terms 

f \ xf \ f x, x rational rn n 

( x ) f( x ) = > . on [0, a], 

( 0, * irrational 

(xi) f(x) = sin 2 (cos * + V] + a 2 ) on [0, a 3 ]. 

(xii) /(*) = [x] on [0, a]: 

2. For each of the following polynomial functions /, find an integer n such 
that f(x) = 0 for some x between n and n + 1 . 

(i) /(*) = * 3 - x + 3. 

(ii) /(*) = * 5 + 5x 4 + 2x + 1. 
(hi) f{x) = x 5 + x+ 1. 

(iv) /(*) = 4* 2 - 4* + 1, 

3. Prove that there is some number x such that 

(i) *i79 + 1^3 = n9 

1 + x 2 + sin 2 # 

(ii) sin x = x — 1 . 

This problem is a continuation of Problem 3-7. 

(a) If n — k is even, and > 0, find a polynomial function of degree n 
with exactly k roots. 

(b) A root a of the polynomial function / is said to have multiplicity m 
if f(x) = (x — a) m g(x), where g is a polynomial function that does 
not have a as a root. Let / be a polynomial function of degree n. 
Suppose that /has k roots, counting multiplicities, i.e., suppose that 
k is the sum of the multiplicities of all the roots. Show that n — k is 
even. 

5, Suppose that / is continuous on [a, b] and that f(x) is always rational. 

What can be said about / ? 
5. Suppose that/is a continuous function on [—1, 1] such that* 2 + (/(*)) 2 = 1 

for all x. (This mean s that ( *, f(x)) always lies on the unit circle.) Show 

that either f{x) = V 1 - x 2 for all x, or else /(*) = - V 1 - x 2 for all *. 
7 . How many continuous functions / are there which satisfy (/(*)) 2 = x 2 

for all x ? 

i. Suppose that / and g are continuous, that f 2 = g 2 , and that /(#) ^ 0 for 
all x. Prove that either f(x) = g (x) for all x, or else /(*) = — g(x) for all #. 
K (a) Suppose that / is continuous, that f(x) = 0 only for x = a, and that 
/(*) > 0 for some x > a as well as for some x < a. What can be said 
about f(x) for all x ^ a ? 
*(b) Using only the fact that x 2 + xy + y 2 ^ 0 if x and are not both 0, 
show that x 2 + xy + y 2 > 0 if x and jy are not both 0. (The trick is 
to consider various fixed y ^ 0, so that you can define a function.) 
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(*, 0) 



*(c) Discuss similarly the sign of x 3 + x 2 y + xy 2 + y z when x and y are 
not both 0. 

10. Suppose / and g are continuous on [a, b] and that f(a) < g(a), but 
f(b) > g(b). Prove that f{x) = g(x) for some x in [a, b). (If your proof 
isn't very short, it's not the right one.) 

11. Suppose that /is a continuous function on [0, 1] and that /(*) is in [0, 1] 
for each x (draw a picture). Prove that /(*) = x for some number x. 

12. (a) Problem 1 1 shows that / intersects the diagonal of the square in 

Figure 14 (solid line). Show that / must also intersect the other 
(dashed) diagonal. 

(b) Prove the following more general fact: If g is continuous on [0, 1] 
and^(0) = 0,g(\) = 1 or^(0) = 1,^(1) = 0, then /(*) = g(x) for 
some x. 

13. (a) Let /(*) = sin \jx for x ^ 0 and let /(0) = 0. Is / continuous on 

[ — 1, 1] ? Show that / satisfies the conclusion of the Intermediate 
Value Theorem on [— 1, 1]; in other words, if / takes on two values 
somewhere on [ — 1, 1], it also takes on every value in between. 
*(b) Suppose that / satisfies the conclusion of the Intermediate Value 
Theorem, and that / takes on each value only once. Prove that / is 
continuous. 

*(c) Generalize to the case where /takes on each value only finitely many 
times. 

14. If / is a continuous function on [0, 1], let ||/|| be the maximum value 

of !/| on [0, 1]. 

(a) Prove that for any number c we have \\cf\\ = \c\ • ||/||. 
*(b) Prove that \\f + g\\ < ||/|| + Give an example where 

\\f + g\\ * 11/11 + hi 

(c) Prove that \\k - /|] < \\h - g\\ + \\g - f\\. 

*15. Suppose that </> is continuous and lim cf)(x)/x n = 0 = lim <j)(x)/x n . 

(a) Prove that if /us odd, then there is a number* such that x n + <f> (x) = 0. 

(b) Prove that if n is even, then there is a number y such that y n + 
000 < x n + </>(*) for all x. 

Hint: Of which proofs does this problem test your understanding? 
*16. Let / be any polynomial funcdon. Prove that there is some number y 

such that 1/001 < |/(*)| for all x. 
*\7. Suppose that / is a continuous function with f(x) > 0 for all x, and 

lim f(x) = 0 = lim f(x). (Draw a picture.) Prove that there is some 

X— ► 00 x—* — 00 

number y such that f(y) > f(x) for all x. 
*18. (a) Suppose that / is continuous on [a, b], and let x be any number. 

Prove that there is a point on the graph of / which is closest to (x, 0) ; 
in other words there is some y in [a, b] such that the distance from 
(x, 0) to (y, f(y)) is < distance from (x, 0) to (z, f(z)) for all z in 
[a, b\ (See Figure 15.) 



(b) Show that this same assertion is not necessarily true if [a, b] is 
replaced by (a> b) throughout. 

(c) Show that the assertion is true if [a. b] is replaced by R throughout. 

(d) In cases (a) and (c), letg(x) be the minimum distance from (*, 0) to 
a point on the graph of /. Prove that g(y) < g(x) + \x — y\, and 
conclude that g is continuous. 

(e) Prove that there are numbers x 0 and x x in [a, b] such that the distance 
from Oo, 0) to Oi,/(*i)) is < the distance from (*</, 0) to (xi\f(xi)) 
for any *</, x\ in [a, b\ 

"19. (a) .Suppose that /is continuous on [0, 1] and /(0) = /(l). Let n be any 
natural number. Prove that there is some number x such that 
f(x) = f(x + 1/n), as shown in Figure 16 for n = 4. Hint: Consider 
the function g(x) = f(x) — f(x + 1/n); what would be true if 
g(x) ^ 0 for all x ? 
(b) Suppose 0 < a < 1 , but that a is not equal to 1 /n for any natural 
number n. Find a function / which is continuous on [0, 1] and which 
satisfies /(0) = /(l), but which does not satisfy f(x) = f(x + a) for 
any x. 

20. (a) Prove that there does not exist a continuous function / defined on 
R which takes on every value exactly twice. Hint: If f(a) — f{b) for 
a < b, then either f(x) > f(a) for all x in (a, b) or f(x) < f{a) for 
all x in {a, b). Why? In the first case all values close to f(a), but 
slightly larger than f(a) } are taken on somewhere in (a, b); this 
implies that f(x) < f(a) for x < a and x > b. 

(b) Refine part (a) by proving that there is no continuous function / 
which takes on each value either 0 times or 2 times, i.e., which 
takes on exactly twice each value that it does take on. Hint: The 
previous hint implies that / has either a maximum or a minimum 
value (which must be taken on twice). What can be said about 
values close to the maximum value? 

(c) Find a continuous function / which takes on every value exactly 
3 times. More generally, find one which takes on every value exactly 
n times, if n is odd. 

(d) Prove that if n is even, then there is no continuous / which takes on 
every value exactly n times. Hint: To treat the case n — 4. for 
example, let f(x{) = f{x 2 ) = /(* 8 ) = f(x A ). Then either /(*) > 0 for 
all x in two of the three intervals (x h # 2 ), (*2, # 8 ), (#3, ^4), or else 
f(x) < 0 for all x in two of these three intervals. 
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LEAST UPPER BOUNDS 



This chapter reveals the most important property of the real numbers. Never- 
theless, it is merely a sequel to Chapter 7; the path which must be followed 
has already been indicated, and further discussion would be useless delay. 



DEFINITION 



A set A of real numbers is bounded above if there is a number x such that 

x > a for every a in A. 
Such a number x is called an upper bound for A. 



Obviously A is bounded above if and only if there is a number x which is an 
upper bound for A (and in this case there will be lots of upper bounds for A) ; 
we often say, as a concession to idiomatic English, that "^4 has an upper 
bound" when we mean that there is a number which is an upper bound for A. 

Notice that the term "bounded above" has now been used in two ways — 
first, in Chapter 7, in reference to functions, and now in reference to sets. This 
dual usage should cause no confusion, since it will always be clear whether 
we are talking about a set of numbers or a function. Moreover, the two defini- 
tions are closely connected: if A is the set {f(x): a < x < b}, then the function 
/ is bounded above on [a, b] if and only if the set A is bounded above. 

The entire collection R of real numbers, and the natural numbers N, are 
both examples of sets which are not bounded above. An example of a set which 
is bounded above is 

A = {x: 0 < x < 1}. 

To show that A is bounded above we need only name some upper bound for 
A, which is easy enough; for example, 138 is an upper bound for A. and so are 
2, l£, 1-^, and 1. Clearly, 1 is the least upper bound of A; although the phrase 
just introduced is self-explanatory, in order to avoid any possible confusion 
(in particular, to ensure that we all know what the superlative of "less" 
means), we define this explicitly. 



DEFINITION 



A number x is a least upper bound of A if 

(1) x is an upper bound of A, 
and (2) if y is an upper bound of A, then x < y. 



Ill 



The use of the indefinite article "a" in this definition was merely a conces- 
sion to temporary ignorance. Now that we have made a precise definition, it is 
easily seen that if x andjv are both least upper bounds of A, then x = y. Indeed, 
in this case 

x < y, since y is an upper bound, and x is a least upper bound, 
and y < x, since x is an upper bound, and y is a least upper bound; 

it follows that x = y. For this reason we speak of the least upper bound of A. 
The term supremum of A is synonymous and has one advantage. It abbrevi- 
ates quite nicely to 

sup A (pronounced "soup A") 
and saves us from the abbreviation 

\\xbA 

(which is nevertheless used by some authors). 

There is a series of important definitions, analogous to those just given, 
which can now be treated more briefly. A set A of real numbers is bounded 
below if there is a number x such that 

x < a for every a in A. 

Such a number x is called a lower bound for A. A number x is the greatest 
lower bound of A if 

(1) x is a lower bound of A, 
and (2) if y is a lower bound of A, then x > y. 

The greatest lower bound of A is also called the infimum of A, abbreviated 

inf A; 

some authors use the abbreviation 

gib A. 

One detail has been omitted from our discussion so far — the question of which 
sets have at least one, and hence exactly one, least upper bound or greatest 
lower bound. We will consider only least upper bounds, since the question for 
greatest lower bounds can then be answered easily (Problem 2). 

HA is not bounded above, then A has no upper bound at all, so A certainly 
cannot be expected to have a least upper bound. It is tempting to say that A 
does have a least upper bound if it has some upper bound, but, like the principle 
of mathematical induction, this assertion can fail to be true in a rather special 
way. If A = 0, then A is bounded above. Indeed, any number x is an upper 
bound for 0: 

x > y for every y in 0, 

simply because there is noy in 0. Since every number is an upper bound for 0, 
there is surely no least upper bound for 0. With this trivial exception however, 
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FIGURE 1 



| 



THEOREM 7-1 

PROOF 




FIGURE 3 



our assertion is true^and very important, definitely important enough to 
warrant consideration of details. We are finally ready to state the last property 
of the real numbers which we need. 

(PI 3) (The least upper bound property) If A is a set of real numbers, 
A y£ 0, and A is bounded above, then A has a least upper bound. 

Property PI 3 may strike you as anticlimactic, but that is actually one of its 
virtues. To complete our list of basic properties for the real numbers we require 
no particularly abstruse proposition, but only a property so simple that we 
might feel foolish for having overlooked it. Of course, the least upper bound 
property is not really so innocent as all that; after all, it does not hold for the 
rational numbers Q,. For example, if A is the set of all rational numbers x 
satisfying x 2 < 2, then there is no rational number y which is an upper bound 
for A and which is less than or equal to every other rational number which is 
an upper bound for A. It will become clear only gradually how significant 
PI 3 is. but we are already in a position to demonstrate its power, by supplying 
the proofs which were omitted in Chapter 7. 

If / is continuous on [a, b] and f(a) < 0 < f(b), then there is some number 
x in [a, b] such that f(x) = 0, 

Our proof is merely a rigorous version of the outline developed at the end of 
Chapter 7— we will locate the smallest number x in [a, b] with f(x) = 0. 
Define the set A, shown in Figure 1, as follows: 

A = {x: a < x < b, and / is negative on the interval [a, x]}. 

Clearly A ^ 0, since a is in A; in fact, there is some 8 > 0 such that A contains 
all points x satisfying a < x < a + 8; this follows from Problem 6-15, since/ 
is continuous on [a, b] and f(a) < 0. Similarly, b is an upper b^und for A and, 
in fact, there is a 8 > 0 such that all points x satisfying b — 8 < x < b are 
upper bounds for A; this also follows from Problem 6-15, since f(b) > 0. 

From these remarks it follows that A has a least upper bound a and that 
a < a < b. We now wish to show that f(a) = 0, by eliminating the possi- 
bilities f(a) < 0 and f(a) > 0. 

Suppose first that f(a) < 0. By Theorem 6-3, there is a 8 > 0 such that 
f(x) < 0 for a -~ 8 < x < a + 8 (Figure 2). Now there is some number x 0 in 
A which satisfies a — 8 < x 0 < a (because otherwise a would not be the least 
upper bound of A). This means that / is negative on the whole interval 
[a, xo]. But if X\ is a number between a and a + 5, then / is also negative on 
the whole interval [x 0 , x\]. Therefore / is negative on the interval [a, x{], so 
x\ is in A. But this contradicts the fact that a is an upper bound for A; our 
original assumption that f(a) < 0 must be false. 

Suppose, on the other hand, that f(a) > 0. Then there is a number 8 > 0 
such that f(x) >0foro; — 8 < x < a + 8 (Figure 3). Once again we know 
that there is an x 0 in A satisfying a — 8 < x 0 < a; but this means that / is 
negative on [a, x 0 ], which is impossible, since f(xo) > 0. Thus the assumption 
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f(a) > 0 also leads to a contradiction, leaving f(a) = 0 as the only possible 
alternative. 

The proofs of Theorems 2 and 3 of Chapter 7 require a simple preliminary 
result, which will play much the same role as Theorem 6-3 played in the previ- 
ous proof. 

THEOREM l If / is continuous at a, then there is a number 8 > 0 such that / is bounded 
above on the interval (a — 8, a + 8) (see Figure 4). 

PROOF Since lim f(x) = f(a), there is, for every s > 0, a 8 > 0 such that, for all x, 

x— *a 

if |* - a\ < 8, then \f(x) - f(a)\ < e. 

It is only necessary to apply this statement to some particular e (any one will 
do), for example, £ = 1 . We conclude that there is a 8 > 0 such that, for all x, 

if \x-a\< 8, then |/(*) - f(a)\ < 1. 

It follows, in particular, that if \x — a\ < 5, then f(x) — f(a) < 1. This 
completes the proof: on the interval (a — 8, a + 8) the function /is bounded 
above by f(a) + 1 . | 

It should hardly be necessary to add that we can now also prove that / is 
bounded below on some interval {a — <5, a + 5), and, finally, that / is bounded 
on some open interval containing a. 

A more significant point is the observation that if lim f(x) = f(a), then 

x-*a + 




1 1 1 

a — 5 a a + 5 



FIGURE 4 
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there is a 6 > 0 such that / is bounded on the set \x\ a < x < a + 8\, and a 
similar observation holds if lim f(x) = f(b). Having made these observations 

x— ► 

(and assuming that you will supply the proofs), we tackle our second major 
theorem. 

THEOREM 7-2 If / is continuous on [a, b], then / is bounded above on [a, b]. 
Let 

A — [x: a < x < b and / is bounded above on [a, x]}. 

Clearly A ^ 0 (since a is in A), and A is bounded above (by 6), so A has a least 
upper bound a. Notice that we are here applying the term ''bounded above' ' 
both to the set A y which can be visualized as lying on the horizontal axis, and 
to /, i.e., to the sets {f(y): a < y < x}, which can be visualized as lying on the 
vertical axis (Figure 5). 

Our first step is to prove that we actually have a = b. Suppose, instead, that 
a < 6. By Theorem 1 there is 5 > 0 such that /is bounded on (a — <5, a + 8). 
Since a is the least upper bound of A there is some ,v 0 in A satisfying a — 8 < 
x 0 < a. This means that / is bounded on [a, x 0 ]. But if xi is any number with 
a < xi < a + 8, then / is also bounded on [x 0 , xi]. Therefore /is bounded on 
[a, #i], so xi is in A, contradicting the fact that a is an upper bound for A. This 
contradiction shows that a — b. One detail should be mentioned: this demon- 
stration implicitly assumed that a < a (so that / would be defined on some 
interval (a — d, a + 5)); the possibility a = a can be ruled out similarly, 
using the existence of a 6 > 0 such that /is bounded on \x: a < x < a + 8} . 

The proof is not quite complete — we only know that / is bounded on [a, x] 
for every x < b y not necessarily that /is bounded on [a, b\ However, only one 
small argument needs to be added. 

There is a 8 > 0 such that / is bounded on {x: b — 8 < x < b} . There is 
#o in A such that b — 8 < x 0 < b. Thus / is bounded on [a, x 0 ] and also on 
[#o, b], so / is bounded on [a, b], | 

To prove the third important theorem we resort to a trick. 

THEOREM 7-3 If / is continuous on [a, b], then there is a number y in [a, b] such that /(y) > 
f(x) for all x in [a, b]. 

PROOF We already know that / is bounded on [a, b], which means that the set 

{/(*):* in [a, b]} 

is bounded. This set is obviously not 0, so it has a least upper bound a. Since 
a > f(x) for x in [a, b] it suffices to show that a = f(y) for some y in [a, b\ 
Suppose instead that a ^ f(y) for all jv in [a, b]. Then the function g denned 

by 

a - fix) 
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is continuous on [a, b], since the denominator of the right side is never 0. On 
the other hand, a is the least upper bound of { f(x) : x in [a 9 b] } ; this means 
that 

for every £ > 0 there is x in [a, b] with a — f(x) < e. 

This, in turn, means that 

for every £ > 0 there is x in [a y b] with g(x) > 1 /e. 

But this means that g is not bounded on [a, b], contradicting the previous 
theorem. | 

At the beginning of this chapter the set of natural numbers N was given as 
an example of an unbounded set. We are now going to prove that N is un- 
bounded. After the difficult theorems proved in this chapter you may be 
startled to find such an "obvious" theorem winding up our proceedings. If so, 
you are, perhaps, allowing the geometrical picture of R to influence you too 
strongly. "Look," you may say, "the real numbers look like 

- — I 1 1 — I • * • 1 — i — i 

0 12 3 n x n + 1 

so every number x is between two integers n, n + 1 (unless x is itself an inte- 
ger)." Basing the argument on a geometric picture is not a proof, however, 
and even the geometric picture contains an assumption: that if you place 
unit segments end-to-end you will eventually get a segment larger than any 
given segment. This axiom, often omitted from a first introduction to geom- 
etry, is usually attributed (not quite justly) to Archimedes, and the corre- 
sponding property for numbers, that N is not bounded, is called the Archi- 
median property of the reals. This property is not a consequence of PI -PI 2 
(see reference [17] of the Suggested Reading), although it does hold for Q,, 
of course. Once we have PI 3 however, there are no longer any problems. 

THEOREM 2 N is not bounded above. 

PROOF Suppose N were bounded above. Since N ^ 0, there would be a least upper 
bound a for N. Then 

a > n for all n in N. 

Consequently, 

ct > n + 1 for all n in N, 

since 72 + 1 is in N if n is in N. But this means that 

a — 1 > n for all n in N, 

and this means that a — 1 is also an upper bound for N, contradicting the fact 
that a is the least upper bound. | 



\ 
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There is a consequence of Theorem 2 (actually an equivalent formulation) 
which we have very often assumed implicitly. 

THEOREM 3 For any £ > 0 there is a natural number n with 1 /n < £. 

PROOF Suppose not; then 1/n > £ for all n in N. Thus n < 1 /s for all n in N. But this 
means that 1/s is an upper bound for N, contradicting Theorem 2. | 

A brief glance through Chapter 6 will show you that the result of Theorem 3 
was used in the discussion of many examples. Of course, Theorem 3 was not 
available at the time, but the examples were so important that in order to 
give them some cheating was tolerated. As partial justification for this dis- 
honesty we can claim that this result was never used in the proof of a theorem, 
but if your faith has been shaken, a review of all the proofs given so far is in 
order. Fortunately, such deception will not be necessary again. We have now 
stated every property of the real numbers that we will ever need. Henceforth, 
no more lies. 

PROBLEMS 

1. Find the least upper bound and the greatest lower bound (if they exist) 
of the following sets. Also decide which sets have greatest and least ele- 
ments (i.e., decide when the least upper bound and greatest lower bound 
happens to belong to the set). 

(i) |-:rcinNj- 

(ii) (-: n in Z and n ^ 0 • 
\n 

(iii) {x: x = 0 or x = 1/n for some n in N}. 

(iv) {x: 0 < x < V2 and x is rational}. 

(v) \x: x 2 + x + 1 > 0}. 

(vi) \x: x 2 + x - 1 < 0}. 

(vii) \x: x < 0 and x 2 + x - 1 < 0}. 

(viii) |- + (»l) n : n in nJ- 

2. (a) Suppose A ^ 0 is bounded below. Let —A denote the set of all —x 

for x in A, Prove that — A ^ 0, that — A is bounded above, and that 
— sup ( — ^4) is the greatest lower bound of A. 
(b) If A 7* 0 is bounded below, let B be the set of all lower bounds of A. 
Show that B 7* 0, that B is bounded above, and that sup B is the 
greatest lower bound of A. 
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3. Let/ be a continuous function on [a> b] with }(a) < 0 < f(b). 

(a) The proof of Theorem 1 showed that there is a smallest x in [a, 6] 
with /(#) = 0. Is there necessarily a second smallest x in [a, 6] 
with f(x) = 0 ? Show that there is a largest * in [a, 6] with/(x) = 0. 
(Try to give an easy proof by considering a new function closely 
related to /.) 

(b) The proof of Theorem 1 depended upon consideration of A = 
{x: a < x < b and / is negative on [a, x]}. Give another proof of 
Theorem 1, which depends upon consideration of B = {x: a < x < b 
and /(*) < 0}. Which point x in [a, b] with /(*) = 0 will this proof 
locate? Give an example where the sets A and B are not the same. 

4. Suppose that /is continuous on [a, b] and that f(a) = /(£) = 0. Suppose 
also that /(*o) > 0 for some x 0 in [a, b\ Prove that there are numbers c 
and with a<c<x 0 <d<b such that /(c) = f(d) = 0, but/(*) > 0 
for all x in (c, d). Hint: The previous problem can be used to good 
advantage. 

5. (a) Suppose that y — x > 1. Prove that there is an integer £ such that 

x < k < y. Hint: Let / be the largest integer satisfying / < x, and 
consider / + 1. 

(b) Suppose x < y. Prove that there is a rational number r such that 
x < r < y. Hint: If 1 /n < y - x, then ny — nx > 1. (Query: Why 
have parts (a) and (b) been postponed until this problem set?) 

(c) Suppose that r < s are rational numbers. Prove that there is an 
irrational number between r and s. Hint: As a start, you know that 
there is an irrational number between 0 and 1. 

(d) Suppose that x < y. Prove that there is an irrational number between 
x and y. Hint: It is unnecessary to do any more work; this follows 
from (b) and (c). 

*6. A set A of real numbers is said to be dense if every open interval contains 
a point of A. For example, Problem 5 shows that the set of rational num- 
bers and the set of irrational numbers are each dense. 

(a) Prove that if / is continuous and /(#) = 0 for all numbers x in a 
dense set A, then f(x) = 0 for all x. 

(b) Prove that if / and g are continuous and f{x) — g{x) for all x in a 
dense set A, then f(x) = g(x) for all x. 

(c) If we assume instead that f(x) > g(x) for all x in A, show that 
f(x) > g(x) for all x. Can > be replaced by > throughout? 

7. Prove that if / is continuous and f(x + y) = f(x) + f(y) for all x and y, 
then there is a number c such that f(x) = cx for all x. (This conclusion 
can be demonstrated simply by combining the results of two previous 
problems.) Point of information: There do exist noncontinuous functions/ 
satisfying /(# + y) = f(x) + f(y) for all x andy, but we cannot prove this 
now; in fact, this simple question involves ideas that are usually never 
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mentioned in any undergraduate course. The Suggested Reading con- 
tains references. 

*8. Suppose that / is a function such that f(a) < f{b) whenever a < b 
(Figure 6). 

(a) Prove that lim f(x) and lim f(x) both exist. Hint: Why is this 

i — ►o - x— >a + 

problem in this chapter? 

(b) Prove that / never has a removable discontinuity (this terminology 
comes from Problem 6-16). 

(c) Prove that if / satisfies the conclusions of the Intermediate Value 
Theorem, then / is continuous. 

*9. If/is a bounded function on [0, 1], let |||/||| = sup {|/(*)|: x in [0, 1]}. 
Prove analogues of the properties of || || in Problem 7-14. 

10. Suppose a > 0. Prove that every number x can be written uniquely in 
the form x = ka + x f , where k is an integer, and 0 < x' < a. 

11. (a) Suppose that a h a 2 , a z , . . . is a sequence of positive numbers with 

fln+i < a n /2. Prove that for any £ > 0 there is some n with a n < S. 

(b) Suppose P is a regular polygon inscribed inside a circle. If P f is the 
inscribed regular polygon with twice as many sides, show that the 
difference between the area of the circle and the area of P f is less 
than half the difference between the area of the circle and the area 
of P (use Figure 7). 

(c) Prove that there is a regular polygon P inscribed in a circle with 
area as close as desired to the area of the circle. In order to do part 
(c) you will need part (a). This was clear to the Greeks, who used 
part (a) as the basis for their entire treatment of proportion and 
area. By calculating the areas of polygons, this method ("the method 
of exhaustion") allows computations of tt to any desired accuracy; 
Archimedes used it to show that < ir < V- But it has far 
greater theoretical importance: 

*(d) Using the fact that the areas of two regular polygons with the same 
number of sides have the same ratio as the square of their sides, 
prove that the areas of two circles have the same ratios as the square 
of their radii. Hint: Deduce a contradiction from the assumption 
that the ratio of the areas is greater, or less, than the ratio of the 
square of the radii by inscribing appropriate polygons. 

12. Suppose that A and B are two nonempty sets of numbers such that x < y 
for all x in A and all y in B, 

(a) Prove that sup A < y for all y in B. 

(b) Prove that sup A < inf B. 

13. Let A and B be two nonempty sets of numbers which are bounded above, 
and let A + B denote the set of all numbers x + y with x in A and y in B, 
Prove that sup (A + B) = sup A + sup B. Hint: The inequality 



sup (A + B) < sup A + sup B is easy. Why? To prove that sup A + 
sup B < sup (A + B) it suffices to prove that sup A + sup B < sup 
(A + B) + £ for all £ > 0; begin by choosing x in A and in 5 with 
sup A — x < s/2 and sup i? — y < e/2. 

FIGURE 8 I 1 1" H H — jj 

14. (a) Consider a sequence of closed intervals h = [a i, b\\,h ~ [a 2, £2], • • • . 

Suppose that a n < <z n+1 and £ n+ i < 6 n for all n (Figure 8). Prove 
that there is a point x which is in every I n . 
(b) Show that this conclusion is false if we consider open intervals 
instead of closed intervals. 

The simple result of Problem 1 4(a) is called the "Nested Interval Theorem. 5 ' 
It may be used to give alternative proofs of Theorems 1 and 2. The appropriate 
reasoning, outlined in the next two problems, illustrates a general method, 
called a "bisection argument." 

*15. Suppose / is continuous on [a, b] and f(a) < 0 < f(b). Then either 
f((a + b) /2) = 0, or / has different signs at the end points of [a, (a + b)/2], 
or / nas different signs at the end points of [(a + b)/2 } b]. Why? If 
f((a + b)/2) y£ 0, let I x be one of the two intervals on which / changes 
sign. Now bisect h. Either / is 0 at the midpoint, or / changes sign on 
one of the two intervals. Let I 2 be such an interval. Continue in this 
way, to define I n for each n (unless / is 0 at some midpoint). Use the 
Nested Interval Theorem to find a point x where f(x) = 0. 

*16. Suppose / were continuous on [a, b], but not bounded on [a, b\ Then 
/would be unbounded on either [a, (a + b)/2] or [(a + b)/2, b]. Why? 
Let Ii be one of these intervals on which / is unbounded. Proceed as in 
Problem 15 to obtain a contradiction. 
17. (a) Let A — {x: x < a}. Prove the following (they are all easy): 

(i) If x is in A and y < x, then y is in A. 

(ii) A ?*0. 

(iii) A * R. 

(iv) If x is in A, then there is some number x' in A such that x < x' '. 

(b) Suppose, conversely, that A satisfies (i)-(iv). Prove that A — 
{x: x < sup A}. 

*18. A number x is called an almost upper bound for A if there are only 
finitely many numbers y in A with y > x. An almost lower bound is 
defined similarly. 

(a) Find all almost upper bounds and almost lower bounds of the sets 
in Problem 1. 

(b) Suppose that A is a bounded infinite set. Prove that the set B of all 
almost upper bounds of A is nonempty, and bounded below. 
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(c) It follows from part (b) that inf B exists; this number is called- the 
limit superior of A, and denoted by lim A or lim sup A. Find lim A 
for each set A in Problem 1. 

(d) Define lim A, and find it for all A in Problem 1. 

*19. If A is a bounded infinite set prove 

(a) lim A < lim A. 

(b) lim A < sup A. 

(c) If lim A < sup A, then A contains a largest element. 

(d) The analogues of parts (b) and (c) for lim . 




, — _ — _ 
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-shadow points - 



FIGURE 9 



*20. Let / be a continuous function on R. A point x is called a shadow point 
of / if there is a number y > x with f(y) > f(x). The rationale for this 
terminology is indicated in Figure 9; the parallel lines are the rays of 
the sun rising in the east (you are facing north). Suppose that all points 
of (a, b) are shadow points, but that a and b are not shadow points. 

(a) For x in (a, b), prove that f(x) < f(b). Hint: Let A — {y: x < y < b 
and f{x) < f(y) } . If sup A were less than b, then sup A would be a 
shadow point. Use this fact to obtain a contradiction to the fact that 
b is not a shadow point. 

(b) Now prove that f(a) < f(b). (This is a simple consequence of 
continuity.) 

(c) Finally, using the fact that a is not a shadow point, prove that 

f(a) =f(b). ' 

This result is known as the Rising Sun Lemma. Aside from serving 
as a good illustration of the use of least upper bounds, it is instru- 
mental in proving several beautiful theorems that do not appear in 
this book; see page 371. 




PART 
DERIVATIVES 
AND 

INTEGRALS 



In 1604, at the height of 
his scientific career, Galileo argued 
that for a rectilinear motion 
in which speed increases proportionally 
to distance covered, 
the law of motion should be 
just that (x = ct 2 ) 
which he had discovered 
in the investigation of falling bodies. 
Between 1695 and 1700 
not a single one of the monthly issues 
of Leipzig's Acta Eruditorum was published 
without articles of Leibniz, 
the Bernoulli brothers 
or the Marquis de I'Hopital treating, 
with notation only slightly different from 
that which we use today, 
the most varied problems of 
differential calculus, integral calculus 
and the calculus of variations. 
Thus in the space of almost precisely 
one century 

infinitesimal calculus or, 
as we now call it in English, 
The Calculus, 

the calculating tool par excellence, 
had been forged; 
and nearly three centuries of 
constant use have not completely dulled 
this incomparable instrument. 



NICHOLAS BOURBAKI 



CHAPTER 




DERIVATIVES 



The derivative of a function is the first of the two major concepts of this section. 
Together with the integral, it constitutes the source from which calculus 
derives its particular flavor. While it is true that the concept of a function is 
fundamental, that you cannot do anything without limits or continuity, and 
that least upper bounds are essential, everything we have done until now has 
been preparation — if adequate, this section will be easier than the preceding 
ones — for the really exciting ideas to come, the powerful concepts that are 
truly characteristic of calculus. 

Perhaps (some would say "certainly") the interest of the ideas to be intro- 
duced in this section stems from the intimate connection between the mathe- 
matical concepts and certain physical ideas. Many definitions, and even some 
theorems, may be described in terms of physical problems, often in a revealing 
way. In fact, the demands of physics were the original inspiration for these 
fundamental ideas of calculus, and we shall frequently mention the physical 
interpretations. But we shall always first define the ideas in precise mathe- 
matical form, and discuss their significance in terms of mathematical problems. 

The collection of all functions exhibits such diversity that there is almost no 
hope of discovering any interesting general properties pertaining to all. 
Because continuous functions form such a restricted class, we might expect to 
find some nontrivial theorems pertaining to them, and the sudden abundance 
of theorems after Chapter 6 shows that this expectation is justified. But the 
most interesting and most powerful results about functions will be obtained 
only when we restrict our attention even further, to functions which have even 
greater claim to be called "reasonable," which are even better behaved than 
most continuous functions. 




(a) (b) (c) 

FIGURE 1 



Figure 1 illustrates certain types of misbehavior which continuous functions 
can display. The graphs of these functions are "bent" at (0, 0), unlike the 
graph of Figure 2, where it is possible to draw a "tangent line" at each point. 
The quotation marks have been used to avoid the suggestion that we have 
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defined "bent" or "tangent line/ 5 although we are suggesting that the graph 
might be "bent" at a point where a "tangent line" cannot be drawn. You 
have probably already noticed that a tangent line cannot be defined as a line 
which intersects the graph only once — such a definition would be both too 
restrictive and too permissive. With such a definition, the straight line shown 
in Figure 3 would not be a tangent line to the graph in that picture, while the 
parabola would have two tangent lines at each point (Figure 4), and the three 
functions in Figure 5 would have more than one tangent line at the points 
where they are "bent." 

FIGURE 3 




A more promising approach to the definition of a tangent line might start 
with "secant lines," and use the notion of limits. If h ^ 0, then the two distinct 
points (a y f(a)) and (a + h,f(a + h)) determine, as in Figure 6, a straight line 
whose slope is 

f(a + h) -/(«) 
h 







a + h y /(< 
>f(a + h) 


/ H 









[a + h)) 
) - f(a) 



FIGURE 6 




As Figure 7 illustrates, the "tangent line" at (a, f(a)) seems to be the limit, in 
some sense, of these "secant lines," as h approaches 0. We have never before 
talked about a "limit" of lines, but we can talk about the limit of their slopes: 
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the slope of the tangent line through (a, f(a)) should be 



\ir* f{a + h) ~~ f{a) 
h-^o h 



We are ready for a definition, and some comments. 



DEFINITION 



The function / is differentiable at a if 



h-^o h 



exists. 



In this case the limit is denoted by /'(a) and is called the derivative of / at 
a. (We also say that / is differentiable if / is differentiable at a for every a 
in the domain of /.) 



The first comment on our definition is really an addendum; we define the 
tangent line to the graph of /at (a, f(a)) to be the line through (a, f(a)) with 
slope f{a). This means that the tangent line at (a, J{a)) is defined only if / is 
differentiable at a. 

The second comment refers to notation. The symbol f(a) is certainly 
reminiscent of functional notation. In fact, for any function/, we denote by/' 
the function whose domain is the set of all numbers a such that / is differ- 
entiable at a, and whose value at such a number a is 



for which lim [f(a + h) - f(a)]/h exists.) The function /' is called the 



derivative of /. 

Our third comment, somewhat longer than the previous two, refers to the 
physical interpretation of the derivative. Consider a particle which is moving 
along a straight line (Figure 8(a)) on which we have chosen an "origin" point 0, 
and a direction in which distances from 0 shall be written as positive numbers, 
the distance from 0 of points in the other direction being written as negative 
numbers. Let s{t) denote the distance of the particle from 0, at time t. The 
suggestive notation s(t) has been chosen purposely; since a distance s(t) is 



h^o h 



(To be very precise: /' is the collections of all pairs 





FIGURE 8(a) 



0 



line along which particle is moving 
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"distance" 




FIGURE 8(b) 



determined for each number /, the physical situation automatically supplies us 
with a certain function s. The graph of s indicates the distance of the particle 
from 0, on the vertical axis, in terms of the time, indicated on the horizontal 
axis (Figure 8(b)). 
The quotient 

s(a + h) — s{a) 
h 

has a natural physical interpretation. It is the "average velocity" of the parti- 
cle during the time interval from a to a + h. For any particular a, this average 
speed depends on k, of course. On the other hand, the limit 

lim — + ^ ~ J W 

h->0 h 

depends only on a (as well as the particular function s) and there are important 
physical reasons for considering this limit. We would like to speak of the 
"velocity of the particle at time a" but the usual definition of velocity is 
really a definition of average velocity; the only reasonable definition of 
"velocity at time a" (so-called "instantaneous velocity") is the limit 

Rm s ( a + h) - s(a) 

h->0 h 

Thus we define the (instantaneous) velocity of the particle at a to be s'(a). 
Notice that s'(a) could easily be negative; the absolute value \s\a)\ is some- 
times called the (instantaneous) speed. 

It is important to realize that instantaneous velocity is a theoretical concept, 
an abstraction which does not correspond precisely to any observable quan- 
tity. While it would not be fair to say that instantaneous velocity has nothing 
to do with average velocity, remember that s\t) is not 

s(t + h) - s(t) 
h 

for any particular k, but merely the limit of these average velocities as h 
approaches 0. Thus, when velocities are measured in physics, what a physicist 
really measures is an average velocity over some (very small) time interval; 
such a procedure cannot be expected to give an exact answer, but this is 
really no defect, because physical measurements can never be exact anyway. 

The velocity of a particle is often called the "rate of change of its position." 
This notion of the derivative, as a rate of change, applies to any other physical 
situation in which some quantity varies with time. For example, the "rate of 
change of mass" of a growing object means the derivative of the function m, 
where m(t) is the mass at time /. 

In order to become familiar with the basic definitions of this chapter, we 
will spend quite some time examining the derivatives of particular functions. 
Before proving the important theoretical results of Chapter 11, we want to 
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slope 2a 




FIGURE 9 



have a good idea of what the derivative of a function looks like. The next 
chapter is devoted exclusively to one aspect of this problem — calculating the 
derivative of complicated functions. In this chapter we will emphasize the 
concepts, rather than the calculations, by considering a few simple examples. 
Simplest of all is a constant function, f(x) = c. In this case 



a-»o h fc-*o 



= 0. 



k h-*Q h 

Thus / is differentiable at a for every number a, and f'(a) — 0. This means 
that the tangent line to the graph of / always has slope 0, so the tangent line 
always coincides with the graph. 

Constant functions are not the only ones whose graphs coincide with their 
tangent lines — this happens for any linear function f(x) = cx + d. Indeed 

f(a + h) -f(a) 



f'(a) = lim 
h- ' 



o h 

c(a + h) + d - [ca + d] 

= hm — 

h->o h 

.. ch 
= lim — = c\ 
h->o h 

the slope of the tangent line is c, the same as the slope of the graph of/. 
A refreshing difference occurs for f(x) = x 2 . Here 

f(a + h) — f(a) 



f'(a) = lim • 
= lim 



(a + h) 2 - a 2 



a 2 + 2ah + h 2 - a 2 

= hm 

a— o h 

= lim {2a + h) 
= 2a. 

Some of the tangent lines to the graph of / are shown in Figure 9. In this pic- 
ture each tangent line appears to intersect the graph only once, and this fact 
can be checked fairly easily: Since the tangent line through (a, a 2 ) has slope 2a, 
it is the graph of the function 

g(x) = 2a(x — a) + a 2 
= 2ax — a 2 . 

Now, if the graph of / and g intersect at a point (x, /(*)) = 0, g(x)), then 

x 2 = 2ax — a 2 
or x 2 — 2ax + a 2 = 0; 
so (x — a) 2 = 0 
or x = a. 



In other words, (a, a 2 ) is the only point of intersection. 
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j{x) = *» 




//slope 3 a 2 


-2a 


Vfa a 3 ) 
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-^H 



The function /(#) = x 2 happens to be quite special in this regard; usually 
a tangent line will intersect the graph more than once. Consider, for example, 
the function f(x) = x 3 . In this case 

/>(,)- lim* + 

h->0 h 

= lim^ + A)3 - a5 



h-^o h 

a 3 + 3a 2 h + 3ah 2 + h 3 - a 3 



= lim 
= lim 

h->0 



3a 2 h + 3ah 2 + h 3 



= lim 3a 2 + 3ah + h 2 
= 3a 2 . 

Thus the tangent line to the graph of / at (a, a 3 ) has slope 3a 2 . This means 
that the tangent line is the graph of 

g(x) — 3a 2 (x — a) + a 3 
= 3a 2 x - 2a 3 . 

The graphs of / and g intersect at the point (*, f{x)) — g(x)) when 

x 3 = 3a 2 x - 2a 3 
or x 3 - 3a 2 x + 2a 3 = 0. 

This equation is easily solved if we remember that one solution of the equation 
has got to be x = a, so that (x — a) is a factor of the left side; the other factor 
can then be found by dividing. We obtain 

(x - a)(x 2 + ax - 2a 2 ) = 0. 

It so happens that x 2 + ax — 2a 2 also has x — a as a factor; we obtain finally 

(x - a)(x - a)(x + 2a) = 0. 

Thus, as illustrated in Figure 10, the tangent line through (a, a 3 ) also inter- 
sects the graph at the point { — 2a, —8a 3 ). These two points are always dis- 
tinct, except when a = 0. 

We have already found the derivative of sufficiently many functions to 
illustrate the classical, and still very popular, notation for derivatives. For a 
given function /, the derivative /' is often denoted by 



For example, the symbol 



FIGURE 10 



df(x) 
dx 

dx 2 
dx 
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denotes the derivative of the function /(*) = x 2 . Needless to say, the separate 
parts of the expression 

df(x) 
dx 

are not supposed to have any sort of independent existence— the d 9 s are not 
numbers, they cannot be canceled, and the entire expression is not the quotient 
of two other numbers "#(*)" and "dx" This notation is due to Leibniz 
(generally considered an independent co-discoverer of calculus, along with 
Newton), and is affectionately referred to as Leibnizian notation.* Although 
the notation df(x)/dx seems very complicated, in concrete cases it may be 
shorter; after all, the symbol dx 2 /dx is actually more concise than the phrase 
"the derivative of the function /(*) = *V 

The following formulas state in standard Leibnizian notation all the infor- 
mation that we have found so far: 

dc 
dx 

d(ax + b) 



= o, 



dx 
dx 2 
dx 



= a 9 



= 2x, 



dx z 

— = 3* 2 . 
dx 

Although the meaning of these formulas is clear enough, attempts at literal 
interpretation are hindered by the reasonable stricture that an equation should 
not contain a function on one side and a number on the other. For example, if 
the third equation is to be true, then either df(x)/dx must denote /'(x), rather 
than/', or else 2x must denote, not a number, but the function whose value at 
x is 2x. It is really impossible to assert that one or the other of these alternatives 
is intended; in practice df(x)/dx sometimes means /' and sometimes means 
/'(*), while 2x may denote either a number or a function. Because of this 
ambiguity, most authors are reluctant to denote f{a) by 

df(x) 
— — W, 

dx 

instead /'(a) is usually denoted by the barbaric, but unambiguous, symbol 

dx 

* Leibniz was led to this symbol by his intuitive notion of the derivative, which he considered 
to be, not the limit of quotients [f(x + h) - f(x)]/h, but the "value" of this quotient when h 
is an "infinitely small" number. This "infinitely small" quantity was denoted by dx and the 
corresponding "infinitely small" difference f(x + dx) - /(*) by df(x). Although this point 
of view is impossible to reconcile with properties (P1)-(P13) of the real numbers, some people 
find this notion of the derivative congenial. 



In addition to these difficulties, Leibnizian notation is associated with one 
more ambiguity. Although the notation dx 2 /dx is absolutely standard, the 
notation df(x)/dx is often replaced by df/dx. This, of course, is in conformity 
with the practice of confusing a function with its value at x. So strong is this 
tendency that functions are often indicated by a phrase like the following: 
"consider the function^ = x 2 ." We will sometimes follow classical practice to 
the extent of using y as the name of a function, but we will nevertheless care- 
fully distinguish between the function and its values— thus we will always say 
something like "consider the function (defined by) y(x) = x 2 ." 

Despite the many ambiguities of Leibnizian notation, it is used almost 
exclusively in older mathematical writing, and is still used very frequently 
today. The staunchest opponents of Leibnizian notation admit that it will be 
around for quite some time, while its most ardent admirers would say that it 
will be around forever, and a good thing too ! In any case, Leibnizian notation 
cannot be ignored completely. 

The policy adopted in this book is to disallow Leibnizian notation within 
the text, but to include it in the Problems; several chapters contain a few 
(immediately recognizable) problems which are expressly designed to illus- 
trate the vagaries of Leibnizian notation. Trusting that these problems will 
provide ample practice in this notation, we return to our basic task of examin- 
ing some simple examples of derivatives. 

The few functions examined so far have all been differentiable. To fully 
appreciate the significance of the derivative it is equally important to know 
some examples of functions which are not differentiable. The obvious candi- 
dates are the three functions first discussed in this chapter, and illustrated in 
Figure 1 ; if they turn out to be differentiable at 0 something has clearly gone 



Now \h\/h = 1 for h > 0, and \h\/h = - 1 for h < 0. This shows that 




Jim 

h-+0 



f(h) - /(0) 



does not exist. 



h 



In fact, 



lim 



m -f(Q) 



= i 



h 



and 



lim 



Kh) -/(0) 



h 



(These two limits are sometimes called the right-hand derivative and the 
left-hand derivative, respectively, of / at 0.) 



Derivatives 133 



If a 7* Q, then /' '(a) does exist. In fact, 

f(x) = 1 if x > 0, 
/'O) = -1 if x < 0. 

The proof of this fact is left to you (it is easy if you remember the derivative of 
a linear function). The graphs of / and of /' are shown in Figure 11. 
For the function 



fix) = i x2 > x -° 



a similar difficulty arises in connection with f(0). We have 



/(« - 7(0) 



- = A, A < 0 
h 

\ = 1, A > 0. 



Therefore, 



lim ^- /(0) = 0, 

but 



Thus /'(0) does not exist; / is not differentiable at 0. Once again, however, 
fix) exists for x ^ 0 — it is easy to see that 



2x, x < 0 
1, * > 0. 



The graphs of / and /' are shown in Figure 12. 

Even worse things happen for /(*) = Vjlj. For this function 

Vh 1 



f(h) - /(0) _ ) A VA 



In this case the right-hand limit 



lim 



h > 0 



h < 0. 



1 



lim _ 

h h-+o+ Vh 



does not exist; instead 1/Va becomes arbitrarily large as h approaches 0. 
And, what's more, — 1 /V ~k becomes arbitrarily large in absolute value, but 
negative (Figure 13). 
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/(*) = 












FIGURE 14 






THEOREM 1 




PROOF 



The function f(x) = \/x, although not differentiable at 0, is at least a little 
better behaved than this. The quotient 

<Th _ h llz = 1 
h h m 



f(h) ~ /(0) 



1 



{<r h y 



simply becomes arbitrarily large as h goes to 0. Sometimes one says that /has 
an "infinite" derivative at 0. Geometrically this means that the graph of/ has 
a "tangent line" which is parallel to the vertical axis (Figure 14). Of course, 
/(#) = — y/x has the same geometric property, but one would say that / has 
a derivative of "negative infinity" at 0. 

Remember that differentiability is supposed to be an improvement over 
mere continuity. This idea is supported by the many examples of functions 
which are continuous, but not differentiable; however, one important point 
remains to be noted: 

If / is differentiable at a, then / is continuous at a. 

f(a + h) — f(a) L 



lim /(a + h) 



• f(a) = lim 



lim h 

h->0 



h-+o h 
= y im f{a + h) ~ f(a) 

a-»o h 
= f(a) • 0 
= 0. 

As we pointed out in Chapter 5, the equation lim f(a + h) — f(a) = 0 is 

h->0 

equivalent to lim f(x) = f(a) ; thus / is continuous at a. | 

It is very important to remember Theorem 1, and just as important to 
remember that the converse is not true. A differentiable function is continuous, 
but a continuous function need not be differentiable (keep in mind the func- 
tion f(x) = |*|, and you will never forget which statement is true and which 
false) . 

The continuous functions examined so far have been differentiable at all 
points with at most one exception, but it is easy to give examples of continuous 
functions which are not differentiable at several points, even an infinite number 
(Figure 15). Actually, one can do much worse than this. There is a function 




FIGURE 15 
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(c) 



(d) 



FIGURE 16 



which is continuous everywhere and differ entiable nowhere! Unfortunately, the defini- 
tion of this function will be inaccessible to us until Chapter 23, and I have been 
unable to persuade the artist to draw it (consider carefully what the graph 
should look like and you will sympathize with his point of view). It is possible 
to draw some rough approximations to the graph, however; several succes- 
sively better approximations are shown in Figure 16. 

Although such spectacular examples of nondifFerentiability must be post- 
poned, we can, with a little ingenuity, find a continuous function which is not 
differentiable at infinitely many points, all of which are in [0, 1]. One such func- 
tion is illustrated in Figure 17. The reader is given the problem of defining it 
precisely; it is a straight line version of the function 

r , . [x sin -5 x ^ 0 
/(*) = \ x 

I 0, x = 0. 

This particular function / is itself quite sensitive to the question of differenti- 
ability. Indeed, for h ^ 0 we have 



, • 1 

/z sin 0 

A . 1 

= sin -• 

h h 



Long ago we proved that lim sin 1 /h does not exist, so f is not differentiable 

at 0. Geometrically, one can see that a tangent line cannot exist, by noting 
that the secant line through (0, 0) and (h, f{h)) in Figure 18 can have any slope 
between —1 and 1, no matter how small we require h to be. 




x sin -i x ?± 0 



0, x = 0 



FIGURE 18 



This finding represents something of a triumph; although continuous, the 
function /seems somehow quite unreasonable, and we can now enunciate one 
mathematically undesirable feature of this function — it is not differentiable 
at 0. Nevertheless, one should not become too enthusiastic about the criterion 
of differentiability. For example, the function 



, N \ x 2 sin j x 0 

g(.x) = { X 



0, 



x = 0 



«• differentiable at 0; in fact ^'(0) = 0: 



U2 • 1 

r sin - 

lim = hm 

h-^o h h-+o h 

= lim A sin - 
h-+o h 

= 0. 

The tangent line to the graph of g at (0, 0) is therefore the horizontal axis 
(Figure 19). 

This example suggests that we should seek even more restrictive conditions 
on a function than mere differentiability. We can actually use the derivative to 
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FIGURE 19 



formulate such conditions if we introduce another set of definitions, the last of 
this chapter. 

For any function /, we obtain, by taking the derivative, a new function /' 
(whose domain may be considerably smaller than that of /). The notion of 
differentiability can be applied to the function /', or course, yielding another 
function (/')', whose domain consists of all points a such that/' is differentiate 
at a. The function (/')' is usually written simply /" and is called the second 
derivative of /. If f f (a) exists, then / is said to be 2-times differentiable at 
a, and the number/'^) is called the second derivative off at a. 

In physics the second derivative is particularly important. If s(t) is the posi- 
tion at time t of a particle moving along a straight line, then s"{t) is called the 
acceleration at time t. Acceleration plays a special role in physics, because, as 
stated in Newton's laws of motion, the force on a particle is the product of its 
mass and its acceleration. Consequently you can feel the second derivative 
when you sit in an accelerating car. 

There is no reason to stop at the second derivative — we can define /'" = 
(/")'» /"" = (/'")', etc. This notation rapidly becomes unwieldy, so the fol- 
lowing abbreviation is usually adopted (it is really a recursive definition) : 

/(*+D = (/<*>)'. 

Thus 

/ (l > = /', 

/<« = f> = (/y, 

fW =/"' = (/")', 

/(« = fx" = {f » y> 

etc. 

The various functions f {h \ for k > 2, are sometimes called higher-order 
derivatives of /. 

Usually, we resort to the notation f k) only for k > 4, but it is convenient to 
have f {k) defined for smaller k also. In fact, a reasonable definition can be made 
for f (0 \ namely, 

/CO, = /. 

Leibnizian notation for higher-order derivatives should also be mentioned. 
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'f'(x) = 2x 






/"(*) - 2 











(c) 



/<*>(*) ** 0, k > 3 



(d) 

FIGURE 20 



The natural Leibnizian symbol for /"(*), namely, 



is abbreviated to 



W 2 ' 



or more frequently to 



Similar notation is used for / (n) (*) ■.. - 

The following example illustrates the notation and also shows, in one 
very simple case, how various higher-order derivatives are related to the 
original function. Let /(*) — x 2 . Then, as we have already checked, 

/'(*) = 2x, 

/"(*) = 2, 

/'"W = 0, 

/<*>(*) = 0, if * > 3. 

Figure 20 shows the function /, together with its various derivatives. 

A rather more illuminating example is presented by the following function, 
whose graph is shown in Figure 21(a): 

x 2 , x>0 
-x\ x < 0. 



/(*) = 



It is easy to see that 
Moreover, 



/'(«) 
/'(«) 

AO) = 



2a if a > 0, 
-2a ifa<0. 



lim 



f{h) -/(0) 



f(h) 



Now 



and 



so 



lim 



h-*0 + h 

lim ^ = lim Z*' _ 0) 



/'(0)-lim^ = 0. 
*->o h 



This information can all be summarized as follows: 

f{x) = 2|*|. 

It follows that /"(0) does not exist! Existence of the second derivative is thus a 
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rather strong criterion for a function to satisfy. Even a "smooth looking" func- 
tion like / reveals some irregularity when examined with the second derivative. 
This suggests that the irregular behavior of the function 

I, sm ~> x 7* 0 
0, x = 0 

might also be revealed by the second derivative. At the moment we know that 
^'(O) = 0, but we do not know g'(a) for any a ^ 0, so it is hopeless to begin 
computing g"(0). We will return to this question at the end of the next chapter, 
after we have perfected the technique of finding derivatives. 



2\x\ 



(*) = 2, x > 0 



PROBLEMS 

1. (a) Prove, working directly from the definition, that if /(*) = 1 A, then 
f(a) = ~\/a\ for a * 0. 

(b) Prove that the tangent line to the graph of / at (a, \/a) does not 
intersect the graph of /, except at {a, I /a). 

2. (a) Prove that if /(*) - 1A 2 , then f'(a) = ~2/a* for a * 0. 
(b) Prove that the tangent line to /at (a, 1/a 2 ) intersects / at one other 

point, which lies on the opposite side of the vertical axis. 

3. Prove that if/W = ^x, then/' (a) = 1/2^, for a > 0. (The expression 
you obtain for [f(a + h) - f(a)]/h will require some algebraic face 
lifting, but the answer should suggest the right trick.) 

4. For each natural number n, let £ n (*) = x w . Remembering that 
Si'(x) = 1, &'(*) = 2x y and &'(*) = 3a: 2 , conjecture a formula for 

S n '(x). Prove your conjecture. (The expression (x + A) n may be expanded 

by the binomial theorem.) 

5. Find/ if /W = [*]. 

(c) 6 % Prove, starting from the definition (and drawing a picture to illustrate) : 

(a) if g(x) = /(*) + c, then g'(x) = /'(*); 

(b) if g(x) = c/W, then £'(*) = </'(*). 

7. Suppose that f(x) — # 3 . 

(a) What is /'(9), /'(25), /'(36)? 

(b) What is/'(3 2 ),/'(5 2 ),/'(6 2 )? 

(c) What isf(a 2 ),/'(* 2 )? 

If you do not find this problem silly, you are missing a very important 
point: f(x 2 ) means the derivative of / at the number which we happen 
to be calling x 2 ; it is not the derivative at x of the function g(x) = f{x 2 ). 
Just to drive the point home: 

(d) For /(*) = x\ compare f'(x 2 ) and g'(x) where g(x) = f{x 2 ). 
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8. (a) Suppose g{x) = f(x + c). Prove (starting from the definition) that 

g'(x) = fix + c). Draw a picture to illustrate this. To do this prob- 
lem you must write out the definitions of g'{x) and f(x + c) cor- 
rectly. The purpose of Problem 7 was to convince you that although 
this problem is easy, it is not an utter triviality, and there is some- 
thing to prove: you cannot simply put prime marks into the equation 
gi x ) — f( x + o). To emphasize this point: 

(b) Prove that if g(x) = f(cx), then g'{x) = c • f(cx). Try to see pictori- 
ally why this should be true, also. 

(c) Suppose that / is differentia ble and periodic, with period a (i.e., 
f(x + a) = f(x) for all x). Prove that /' is also periodic. 

9. Find fix) and also fix + 3) in the following cases. Be very methodical, 
or you will surely slip up somewhere. Consult the answers (after you do 
the problem, naturally). 

(i) fx) = ix + 3)\ 

(ii) fx + 3) = x\ 

(iii) f(x + 3) = ix + 5)\ 

10. Find f(x) if fix) = git + x), and if /(*) - git + x). The answers will 
not be the same. 

11. (a) Prove that Galileo was wrong: if a body falls a distance s(t) in t sec- 

onds, and s f is proportional to s, then s cannot be a function of the 
form sit) = ct 2 . 

(b) Prove that the following facts are true about s if sit) = (a/2)t 2 (the 
first fact will show why we switched from c to a/2): 

(i) s"(t) = a (the acceleration is constant). 

(ii) [/(/)]* = lasit). 

(c) If s is measured in feet, the value of a is 32. How many seconds do 
you have to get out of the way of a chandelier which falls from a 400- 
foot ceiling? If you don't make it, how fast will the chandelier be 
going when it hits you? Where was the chandelier when it was mov- 
ing with half that speed? 

12. Imagine a road on which the speed limit is specified at every single point. 
In other words, there is a certain function L such that the speed limit x 
miles from the beginning of the road is £(*). Two cars, A and B y are 
driving along this road; car ^4's position at time t is a(t), and car B's is 
bit). 

(a) What equation expresses the fact that car A always travels at the 
speed limit? (The answer is not a' it) = Lit).) 

(b) Suppose that A always goes at the speed limit, and that 2?'s position 
at time t is ^4's position at time t — 1. Show that B is also going at 
the speed limit at all times. 

(c) Suppose B always stays a constant distance behind A. Under what 
conditions will B still always travel at the speed limit? 
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13. Suppose that/(<z) = g(a) and that the left-hand derivative of/ at a equals 
the right-hand derivative of g at a. Define h{x) = fix) for x < a, and 
h(x) = g(x) for x > a. Prove that h is differentiate at a. 

14. Let fix) — x 2 if x is rational, and fix) = 0 if x is irrational. Prove that /is 
differentiable at 0. (Don't be scared by this function. Just write out the 
definition of /'(0).) 

*15. (a) Let / be a function such that |/(*)| < x 2 for all x. Prove that / is 
differentiable at 0. (If you have done Problem 14 you should be able 
to do this.) 

(b) This result can be generalized if x 2 is replaced by \g(x)\> where g has 
what property? 

16. Let a > 1. If / satisfies \f(x)\ < \x\ a , prove that / is differentiable at 0, 

17. Let 0 < 0 < 1. Prove that if /satisfies |/(*)| > \x\ 0 and/(0) = 0, then 
/ is not differentiable at 0. 

*18. Let /(*) = 0 for irrational x, and \/q for x — p/q in lowest terms. Prove 
that / is not differentiable at a for any a. Hint: It obviously suffices to 
prove this for irrational a. Why? If a = n.aia 2 a 5 ... is the decimal 
expansion of a, consider [f(a + h) — f(a)]/h for h rational, and also for 

h = -0.00 . . . 0tf n+ ia n+2 .... 

19. (a) Suppose that f(a) = g(a) = h(a), that f(x) < g(x) < h(x) for all x, 

and that f(a) = ti(a). Prove that g is differentiable at a, and that 
f(a) = g'(a) = h'{a). (Begin with the definition of g'(a).) 
(b) Show that the conclusion does not follow if we omit the hypothesis 
f(a) = g(a) = h(a). 

20. Let / be any polynomial function; we will see in the next chapter that 
/ is differentiable. The tangent line to / at {a, f(a)) is the graph oig(x) = 
f(a)(x — a) + f(a). Thus f(x) — g(x) is the polynomial function d(x) = 
f(x) — f(a)(x — a) — f(a). We have already seen that if fix) = x 2 , then 
d(x) = (x - a) 2 , and iff(x) = x\ then dix) = (* - a) 2 (x + 2a). 

(a) Find when/(x) = x 4 , and show that it is divisible by (x — a) 2 . 

(b) There certainly seems to be some evidence that d(x) is always 
divisible by (x — a) 2 . Figure 22 provides an intuitive argument: 
usually, lines parallel to the tangent line will intersect the graph at 
two points; the tangent line intersects the graph only once near the 
point, so the intersection should be a "double intersection. 55 To give 
a rigorous proof, first note that 

d{x) = /(*) -}{a) _ f(a) 
x — a x — a 

Now answer the following questions. Why is fix) — fia) divisible by 
(x — a)? Why is there a polynomial function h such that h(x) = 
dix) fix - a) for x a ? Why is lim k(x) = 0 ? Why is h{a) = 0 ? 

Why does this solve the problem? 



142 Derivatives and Integrals 



21. (a) Show that f(a) = Km [/(*) - /(*)]/(* - a). (Nothing deep here.) 

x— *a 

(b) Show that derivatives are a "local property": iff(x) = g{x) for all x 
in some open interval containing a, then f'(a) = g'(a). (This means 
that in computing/' (a), you can ignore f(x) for any particular x ^ a. 
Of course you can't ignore /(*) for all such x at once!) 

*22. (a) Suppose that / is differentiable at x. Prove that 

/(,)- lim + 

fc-o 2A 

Hint: Remember an old algebraic trick — a number is not changed 
if the same quantity is added to and then subtracted from it. 
**(b) Prove, more generally, that 

f{x) = Iim /(* + *)-/(«-*), 

h,k-^o + h + k 

*23. Prove that if / is even, then /'(*) = —/'(—*). (In order to minimize 
confusion, let g(x) = f(—x); find g'(x) and then remember what other 
thing g is.) Draw a picture! 

*24. Prove that if / is odd, then /'(*) = /'(—#). Once again, draw a picture. 

25. Problems 23 and 24 say that /' is even if / is odd, and odd if / is even. 
What can therefore be said about f {k) ? 

26. Find /"(*) if 

(i) f(x) = x*. 

(ii) f{x) = xK 

(iii) f(x) = 

(iv) fix + 3) = 

27. If - x n , and 0 < £ < n, prove that 

-"CD*"' 

*28. (a) Find /'(*) if/(*) - |*|». Find /"(*). Does /"'(*) exist for all * ? 

(b) Analyze / similarly if /(*) = x 4 for x > 0 and /(a:) = — x 4 for * < 0. 

*29. Let fix) = * n for * > 0 and let /(*) = 0 for x < 0. Prove that /^"^ 
exists (and find a formula for it), but that / (n) (0) does not exist. 

30. Interpret the following specimens of Leibnizian notation; each is a 
restatement of some fact occuring in a previous problem. 

dxn 

(i) — = nx n \ 
dx 



dy 



..... d[f(x) + c] _ df{x) 

(ul) — IT ST 

, . dz dy , c , 
v) - = f it z = y + c 
dx dx 



(vi) 



dx* 
dx 



= 3a 4 . 



(Vll) —7— 

, .... 

(viu) — — 



rf/(ex) #00 
(1X) ^T = C "^~ 



CHAPTER 




DIFFERENTIATION 



The process of rinding the derivative of a function is called differentiation. From 
the previous chapter you may have the impression that this process is usually 
laborious, requires recourse to the definition of the derivative, and depends 
upon successfully recognizing some limit. It is true that such a procedure is 
often the only possible approach— if you forget the definition of the derivative 
you are likely to be lost. Nevertheless, in this chapter we will learn to differ- 
entiate a large number of functions, without the necessity of even recalling the 
definition. A few theorems will provide a mechanical process for differentiating 
a large class of functions, which are formed from a few simple functions by the 
process of addition, multiplication, division, and composition. This description 
should suggest what theorems will be proved. We will first find the derivative 
of a few simple functions, and then prove theorems about the sum, products, 
quotients, and compositions of differentiable functions. The first theorem is 
merely a formal recognition of a computation carried out in the previous 
chapter. 



THEOREM l If / is a constant function, f(x) = c, then 

f(a) — 0 for all numbers a. 



PROOF 



THEOREM 2 

PROOF 



/'(*) 



lim 

h-^o h 



The second theorem is also a special case of a computation in the last 
chapter. 

If / is the identity function, f(x) = x, then 

1 for all numbers a. 



f'(a) - 
f'{a) 



: lim tAjZ M 

h-+o h 

a + h — a 
lim 

h-+o h 

lim - = l.| 

h-+0 h 



The derivative of the sum of two functions is just what one would hope- 
the sum of the derivatives. 
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THEOREM 3 



PROOF 



THEOREM 4 



PROOF 



If / and g are differentiable at a, then / + g is also differentiable at a, and 
(/ + *)'(*) = /'(«)+*'(«). 
(/ + gY(a) = lim (/ + ^ + *)-(/ + g )(g) 

fc-+0 h 

= ]im ^ ± ± g(g + A > ~ t/W + g(g)j 
a-o h 



= lim r 



fa + A) — /(g) £(a + A) — 



= lim /(° + ^)-/W + ^ *(« + *)-*(«) 
h-*o h h->o h 

= /'W + *'(«)•■ 

The formula for the derivative of a product is not as simple as one might 
wish, but it is nevertheless pleasantly symmetric, and the proof requires only a 
simple algebraic trick, which we have found useful before — a number is not 
changed if the same quantity is added to and subtracted from it. 

If / and g are differentiable at a, then / • g is also differentiable at a, and 
(/"*)'(*) =f(a)'g(a) +f(a)-g'(a). 

(f'g)(* + h) - (/•*)(«) 



(f-g)'(a) =lim 
= lim 

/i->0 



/(<2 + %(* + A) - f(a)g(a) 



lim r 



f{a + h)[g{a + h) - g(a)l | [/(a + A) - /( a )]g(a) 



- lim /(a + h) ■ lim g(* + + lim /(« + *)-/(«) . ^ (-) 

= /(«)•*'(«) + /'(«)•*«. 

(Notice that we have used Theorem 9-1 to conclude that lim /(a + A) = /(a)-) I 



In one special case Theorem 4 simplifies considerably: 

THEOREM 5 If g(x) = cf(x) and / is diflPerentiable at a, then g is differentiable at a, and 

*'(«) =c •/'(*). 

PROOF If h{x) = c, so that g = h-f, then by Theorem 4, 

g'(a) = (A •/)'(«) 

= A (a) ■f(a)+k'(a) ■ f(a) 
= c-f'(a) + 0-f(a) 
= c-f{a).\ 
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Notice, in particular, that (— f)'{a) = —f(a), and consequently (/ — g)'{a) 
= (f+l-g]Y(a)=f'(a)-g'(a). 

To demonstrate what we have already achieved, we will compute the 
derivative of some more special functions. 

THEOREM € If f( x ) = x n for some natural number n, then 

f(a) = na n ~ l for all a, 

PROOF The proof will be by induction on n. For n — 1 this is simply Theorem 2. Now 
assume that the theorem is true for n y so that if f(x) = x n , then 

f(a) = na*' 1 for all a. 

Let g(x) = * n+1 . If I(x) = x, the equation x n+1 = x n • x can be written 

g(x) — f(x) ■ I(x) for all x; 

thus £=/•/. It follows from Theorem 4 that 

g'(a) = U-D'(a) = f(a) • 7( fl ) + /(«) ■ I'(a) 
= rca w_1 ' a + a n ' \ 
= «fl n + a n 

= 0 + l)a n , for all a. 
This is precisely the case + 1 which we wished to prove. | 

Putting together the theorems proved so far we can now find /' for / of the 
form 

/(*) = a n x n + a n ^ix n ~' 1 + - • • + a 2 x 2 + a x x + a 0 . 

We obtain 

/'(*) = rc^**- 1 + (n - lK^i*"- 2 + • • • + 2a 2 * + a x . 

We can also find /": 

/"(*) = »(„ - IK*"" 2 + (« - \){n - 2)a n ^x n ^ + : • • + 2a,. 

This process can be continued easily. Each differentiation reduces the highest 
power of x by 1 , and eliminates one more a,-. It is a good idea to work out the 
derivatives /"', / (4) , and perhaps / (5) , until the pattern becomes quite clear. 
The last interesting derivative is 



for k > n we have 



/<»>(*) = n\a n ; 
/<*>(*) = 0. 



Clearly, the next step in our program is to find the derivative of a quotient 
fig. It is quite a bit simpler, and, because of Theorem 4, obviously sufficient 
to find the derivative of 1/g. 
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THEOREM 7 If g is differentiable at a, and g(a) * 0, then 1/g is differentiable at a, and 



PROOF Before we even write 



0 w wi? 



©<«+*>-(> 



we must be sure that this expression makes sense — it is necessary to check that 
(Vg)0* + A) is defined for sufficiently small h. This requires only two observa- 
tions. Since g is, by hypothesis, differentiable at a, irfollows from Theorem 9-1 
that g is continuous at a. Since g(a) iA 0, it follows from Theorem 6-3 that 
there is some 8 > 0 such that g(a + h) ^ 0for|A| < 6. Therefore (\/g) {a + h) 
does make sense for small enough h, and we can write 

ii„V V_, lim «<i±*L_«<5> 



= lim 



a-o + A)] 

_ Um ~[g(a + h) -g(a)} , 1 

ft-o A g(fl)g(a + h) 

_ lim -[,(« + *)-,(«)] . lim ___L__ 

a-o A fc-»o g(a) ' g(a + «) 

[gwr 

(Notice that we have used continuity of g at a once again.) | 

The general formula for the derivative of a quotient is now easy to derive. 
Though not particularly appealing, it is important, and must simply be 
memorized (I always use the incantation: "bottom times derivative of top, 
minus top times derivative of bottom, over bottom squared.") 

theorem 8 Iff and g are differentiable at a and g(a) 7* 0, then f/g is differentiable at a y 
and 

kg) {a) = sw? 
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PROOF Since f/g =/• (1/g) we have 

= /'(«) i /(gKzg^M) 

*(«) teWl 2 
[*(«)? 

We can now differentiate a few more functions. For example, 

• r r ( v ^~ 1 . v ( X 2 +1)(2^) - 1)(2*) _ . 

lf /W - then / W (* 2 + i) 2 ' 

, fM * t , , {x*+\)-x(2x) 1 -* 2 . 

if /(*) = 1, then /'(*) = - ~ = (~1)*~ 2 . 
x x 2 

Notice that the last example can be generalized: if 

f(x) = x ~ n = — > for some natural number n, 

x n 

then 

— nx n ~ l 

/'W = -fsr- = 

thus Theorem 6 actually holds both for positive and negative integers. If we 
interpret f(x) = *° to mean /(x) = 1, and /'(*) = 0 ' * _1 to mean/'(*) = 0, 
then Theorem 6 is true for n = 0 also. (The word "interpret" is necessary 
because it is not clear how 0° should be defined and, in any case, 0 • (T 1 is 
meaningless.) 

Further progress in differentiation requires the knowledge of the derivatives 
of certain special functions to be studied later. One of these is the sine function. 
For the moment we shall divulge, and use, the following information, without 
proof: 

sin' (a) — cos a for all a, 
cos' (a) — — sin a for all a. 

This information allows us to differentiate many other functions. For example, 
if 

f(x) = x sin x, 

then 

/'(*) = x cos x + sin *, 

/"(*) = — * si n x + cos x + cos x 
= —x sin x + 2 cos x; 
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if 

g(x) = sin 2 x = sin x • sin 

then 

= sin x cos a: + cos x sin # 
= 2 sin ^ cos x, 
g"(x) = 2[(sin #)( — sin x) + cos x cos x] 
= 2[cos 2 ^ — sin 2 *]; 

if 

A(#) = cos 2 x — cos x ' cos a:, 

then 

h'(x) = (cos #)( — sin x) + (— sin x) cos # 

= — 2 sin ^ cos 
/?"(*) = — 2[cos 2 # — sin 2 x\ 

Notice that 

g'{x) + h'(x) = 0, 

hardly surprising, since + h)(x) = sin 2 a: + cos 2 x = 1. As we would 
expect, we also have g"{x) + h"(x) = 0. 

The examples above involved only products of two functions. A function 
involving triple products can be handled by Theorem 4 also; in fact it can be 
handled in two ways. Remember that / • g • h is an abbreviation for 

(/■*)•* or f'(g'h). 
Choosing the first of these, for example, we have 

(f'g' h)'(x) = (/ • g)'(x) • h{x) + (/ • g)(x)h'(x) 

= [f(x)g(x) +f(x)g'(x)]h(x) +f{x)g(x)h'{x) 
= f(x)g(x)h(x) +f(x)g'(x)h(x) +f(x)g(x)h'(x). 

The choice of / • (g • h) would, of course, have given the same result, with a 
different intermediate step. The final answer is completely symmetric and 
easily remembered: 

(/ ' g * h)' is the sum of the three terms obtained by differentiating each 
of/, g, and h and multiplying by the other two. 

For example, if 

f(x) = x z sin x cos x, 

then 

f(x) = 3x 2 sin x cos x + x 3 cos x cos x + x z (sin x)(— sin x). 

Products of more than 3 functions can be handled similarly. For example, you 
should have little difficulty deriving the formula 

(f-g-h- *)'(*) = f'(x)g(x)h(x)k(x) + f{x)g'{x)h{x)k{x) 

+ f(x)g{x)h'{x)k{x) + f(x)g(x)h(x)k'(x). 

You might even try to prove (by induction) the general formula: 

n 

(/x-... •/»)'(*) = J/ito • • • • -/.-iW/.-'W/i+iW • • • • •/.(*)• 



Differentiating the most interesting functions obviously requires a formula 
f° r (/ ° gYW in terms of /' and g'. To ensure that / ° g be differentiate at a, 
one reasonable hypothesis would seem to be that g be differentiate at a. Since 
the behavior oif°g near a depends on the behavior of/ near g(a) (not near a), 
it also seems reasonable to assume that / is differentiate at g(a). Indeed we 
shall prove that if g is differentiate at a and / is differentiate at g(a), then 
/ o g is differentiate at a, and 

(fog)' (a) = f'(g(a)) ■ g'{a). 

This extremely important formula is called the Chain Rule, presumably because 
a composition of functions might be called a "chain" of functions. Notice that 
(f°g)' is practically the product off and g', but not quite: /' must be evalu- 
ated at g(a) and g' at a. Before attempting to prove this theorem we will try a 
few applications. Suppose 

f(x) = sin x 2 . 

Let us, temporarily, use S to denote the ("squaring") function S(x) = x 2 . Then 

/ = sin o S. 

Therefore we have 

/'(*) = S in'(S(x)) ■ S'(x) 
= cos x 2 • 2x. 

Quite a different result is obtained if 

f(x) = sin 2 x. 

In this case 

/ = S o sin, 

so 

/'(*) = ^(sin x) • sin'(*) 
= 2 sin x m cos x. 

Notice that this agrees (as it should) with the result obtained by writing 
/ = sin • sin and using the product formula. 

Although we have invented a special symbol, S, to name the "squaring" 
function, it does not take much practice to do problems like this without 
bothering to write down special symbols for functions, and without even 
bothering to write down the particular composition which / is — one soon 
becomes accustomed to taking / apart in one's head. The following differ- 
entiations may be used as practice for such mental gymnastics — if you find it 
necessary to work a few out on paper, by all means do so, but try to develop 
the knack of writing /' immediately after seeing the definition of /; problems of 
this sort are so simple that, if you just remember the Chain Rule, there is no 
thought necessary. 

if f(x) = sin x 3 then /'(*) = cos x z • 3x 2 

f(x) = sin 3 x /'(*) = 3 sin 2 x • cos x 
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fix) — sin — 
x 



«4— 

f{x) = cos (sin x) • cos x 
fix) = cos(* 3 + 3* 2 ) • (3a: 2 + 6x) 
fix) = 53(* 3 + 3* 2 ) 52 • (3* 2 + 6x). 



fix) = sin (sin x) 
fix) = sin(* 3 + 3* 2 ) 
fix) = (* 3 + 3* 2 ) 53 
A function like 

/(*) = sin 2 x 2 = [sin * 2 ] 2 , 
which is the composition of three functions, 

/ = S o sin o S, 

can also be differentiated by the Chain Rule. It is only necessary to remember 
that a triple composition f°g°h means (/ o g) o h or / © ig o h). Thus if 

fix) = sin 2 x 2 

we can write 

/ = (S o sin) o S, 
f= So (sin o^). 

The derivative of either expression can be found by applying the Chain Rule 
twice; the only doubtful point is whether the two expressions lead to ec-ually 
simple calculations; As a matter of fact, as any experienced tlifferentiator 
knows, it is much better to use the second: 



f = So (sin o^). 



We can now write down fix) in one fell swoop. To begin with, note that the 
first function to be differentiated is S, so the formula for fix) begins 

Inside the parentheses we must put sin * 2 , the value at x of the second 
function, sin ° S. Thus we begin by writing 

fix) = 2 sin x 2 • BllifSI 

(the parentheses weren't really necessary, after all). We must now multiply 
this much of the answer by the derivative of sin © S at x; this part is easy — it 
involves a composition of two functions, which we already know how to 
handle. We obtain, for the final answer, 

fix) = 2 sin x 2 • cos x 2 • 2x. 

The following example is handled similarly. Suppose 



f{x) = sin (sin x 2 ). 



Without even bothering to write down / as a composition g o h © k of three 
functions, we can see that the left-most one will be sin, so our expression for 
fix) begins 

/'(*)= cos( ) 



Inside the parenthesis we must put the value of h o k(x); this is simply sin x 2 
(what you get from sin (sin x 2 ) by deleting the first sin). So our expression for 
f(x) begins 

fix) = cos(sin x 2 ) • - 

We can now forget about the first sin in sin (sin x 2 ) ; we have to multiply what 
we have so far by the derivative of the function whose value at x is sin x 2 — 
which is again a problem we already know how to solve: 

f{x) = cos (sin x 2 ) * cos x 2 • 2x. 

Finally, here are the derivatives of some other functions which are the com- 
position of sin and S y as well as some other triple compositions. You can proba- 
bly just "see" that the answers are correct — if not, try writing out / as a 
composition : 

if fx) = sin ((sin x) 2 ) then /'(*) = cos ((sin x) 2 ) * 2 sin x • cos x 
fx) — [sin (sin x)] 2 f(x) = 2 sin (sin x) ' cos (sin x) • cos x 

fx) = sin (sin (sin x)) fix) = cos (sin (sin x)) * cos (sin *) * cos x 

fx) = sin 2 (# sin x) f(x) = 2 sin (a* sin x) ' cos(x sin x) 

• [sin * + x cos *] 

/(*) = sin (sin (x 2 sin x)) f(x) — cos (sin (x 2 sin x)) 

• cos (a; 2 sin x) • [2x sin x + x 2 cos x]. 

The rule for treating compositions of four (or even more) functions is easy — 
always (mentally) put in parentheses starting from the right, 

fo(go(hok)) 9 

and start reducing the calculation to the derivative of a composition of a 
smaller number of functions: 

f(g(h(k( x ))))-z 

For example, if 



then 
if 

then 
if 

then 



fx) = sin 2 (sin 2 (*)) [f = S o sin o S o sin 

= S o (sin o (5 o sin))] 

fix) = 2 sin(sin 2 x) * cos(sin 2 x) * 2 sin * • cos 

/(*) = sin((sin x 2 ) 2 ) [/ = sin o ^ o sin o .S* 

= sin © iS o (sin o »S))] 

fix) = cos((sin a: 2 ) 2 ) '• 2 sin a 2 • cos x 2 ■ 2a:; 

/(a:) = sin 2 (sin(sin a:)) [fill in yourself, if necessary] 

/'(*) = 2 sin (sin (sin x)) • cos (sin (sin x)) ' cos (sin x) • cos x. 



Differentiation 153 



With these examples as reference, you require only one thing to become a 
master differentiator — practice. You can be safely turned loose on the exercises 
at the end of the chapter, and it is now high time that we proved the Chain Rule. 

The following argument, while not a proof, indicates some of the tricks one 
might try, as well as some of the difficulties encountered. We begin, of course, 
with the definition — 

(/.,)'(.) (/'*)(« + *>-(/•*)(«> 

h 

- lim f(s(a + h)) -f(g(a)) 
h-+o h 

Somewhere in here we would like the expression for g'(a). One approach is to 
put it in by fiat: 

\im f(s(a + A)) -f^(a)) _ lim f^(a + h)) - f(g(a)) g(a + h) - g{a) 
h-+o h h-^o g(a + h) — g(a) h 

This does not look bad, and it looks even better if we write 

lim (/°g>( g + *) ~ (/«*)(«) 
*-o h 

= l im f(s(a) + W + h)- g(a)]) - f(g(a)) . ^ g(a + h) - g(a) 
h-^o g(a + h) — g(a) a— +o h 

The second limit is the factorg'(tf) which we want. Ifwelet^(a + h) — = k 
(to be precise we should write k (ti)) y then the first limit is 

Hm /kM±*) -/(*(«)) ' 

/i-»o A; 

It looks as if this limit should be f(g(a)), since continuity of g at a implies that 
k goes to 0 as A does. In fact, one can, and we soon will, make this sort of rea- 
soning precise. There is already a problem, however, which you will have 
noticed if you are the kind of person who does not divide blindly. Even for 
A^Owe might have g(a + h) — g(a) = 0, making the division and multipli- 
cation by g(a + h) — g(a) meaningless. True, we only care about small h, 
but g(a + h) — g{a) could be 0 for arbitrarily small h. The easiest way this 
can happen is for g to be a constant function, g{x) = c. Then g(a + h) — 
g(a) = 0 for all h. In this case, / © g is also a constant function, (/ ° g) (x) = f(c), 
so the Chain Rule does indeed hold: 

(fogY (a) = 0 = f(g(a))-g'(a). 

However, there are also nonconstant functions £ for which g (a + h) — (a) = 0 
for arbitrarily small h. For example, if a = 0, the function g might be 

II 
sin -i # 5^ 0 
* 
0, * = 0. 
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THEOREM 9 (THE CHAIN RULE) 



PROOF 



In this case, ^'(O) = 0, as we showed in Chapter 9. If the Chain Rule is correct, 
we must have (f ° g)'(0) = 0 for any differentiable /, and this is not exactly 
obvious. A proof of the Chain Rule can be found by considering such recalci- 
trant functions separately, but it is easier simply to abandon this approach, and 
use a trick. 

If g is differentiable at a, and / is differentiable at g(a), then / ° g is differenti- 
able at a, and 

(/•*)'(«) =/'(*(«))•*'(«)• 



ilg(a + h) -g(a) ^0 
if g(a + h) -g(a) = 0. 



Define a function 0 as follows. 

( f(g{a + h)) - f(g(a)) 
4>{h) = g(a + h) — g{a) 
I /(*(«)), 

It should be intuitively clear that 0 is continuous at 0: When h is small, 
g(a + h) — g{a) is also small, so if g(a + h) — g{a) is not zero, then 0(A) will 
be close to f(g(a)); and if it is zero, then <f>(h) actually equals f(g(a)), which 
is even better. Since the continuity of <j> is the crux of the whole proof we will 
provide a careful translation of this intuitive argument. 
We know that / is differentiable at g(a). This means that 

]im M±i^)) =/W) . 

o k 

Thus, if £ > 0 there is some number 5' > 0 such that, for all k, 

f(g(a) +k)- f(g(a)) 



(1) if 0 < \k\ < <5', then 



-/'(*(«)) 



< £. 



Now g is differentiable at a, hence continuous at a, so there is a 8 > 0 such 
that, for all h, 

(2) if \h\ < 8, then \g(a + h) - g(a)\ < 8'. 

Consider now any h with \h\ < 8. If k — g(a + h) — g(a) 5* 0, then 

f(g(a + h)) - f(g(a)) _ f(g(a)+k) - f(g(a)) . 

A 



4>{h) - 



g(<i + A) — 

it follows from (2) that \k\ < 8', and hence from (1) that 

\Mh) -f(g(a))\ < 6. 

On the other hand, if g(a + h) - g(a) = 0, then <t>(h) = f'(g(a)) 9 so it is 
surely true that 

\<t>(h) -f(g(a))\ < S. 
We have therefore proved that 

lim 0(A) =f'(g(a)), 

A->0 
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so 4> is continuous at 0. The rest of the proof is easy. If h ?± 0, then we have 
f(g(a + A) ~ f(g(a)) = (A) . g(g + A) - g(g) 

even if g(a + A) — g(#) = 0 (because in that case both sides are 0). Therefore 
{fog y (a) = lim M + h))-f(i(a)) _ Um ^ . Hm ii* + h) — gM 

= /ok*) w« • i 

Now that we can differentiate so many functions so easily we can take 
another look at the function 



/(*) 



x 2 sin -j x 5* 0 
. 0, x = 0. 



In Chapter 9 we showed that f(0) = 0, working straight from the definition 
(the only possible way). For x ^ 0 we can use the methods of this chapter. 
We have 



f(x) = 2x sin - + x 2 cos - • (— ^-Y 
x x \ x 2 / 



Thus 

/'(*) = 



2x sin - — cos -j x 5* 0 

a: a: 

0, x = 0. 



As this formula reveals, the first derivative /' is indeed badly behaved at 0 — 
it is not even continuous there. If we consider instead 

N ( x 3 sin -j x 0 
/(*) = | * 

I 0, * = 0, 

then 

, r/ \ ( 3# 2 sin - — at cos -j jf ^ 0 
/ (*) = \ x X 

I 0, ^ = 0. 

In this case /' is continuous at 0, but /"(0) does not exist (because the expres- 
sion 3a: 2 sin 1/x defines a function which is differentiable at 0 but the expres- 
sion — x cos 1/x does not). 

As you may suspect, increasing the power of x yet again produces another 
improvement. If 



/« = 



x 4 sin -j x 0 
x 

. 0, * = 0, 



then 



1 1 

4# 3 sin x 2 cos -> x 5* 0 

0, * = 0. 



It is easy to compute, right from the definition, that (/')'(O) = 0, and /"(*) is 
easy to find for x ?± 0: 

„, . ( \2x 2 sin - — Ax cos - — 2x cos - — sin x 0 
/ W = t * x a: a: 

I 0, * = 0. 

In this case, the second derivative /" is not continuous at 0. By now you may 
have guessed the pattern, which two of the problems asks you to establish: if 



/(*) - 



1 

1 i x 0 
x 



10, x = 0, 

then/'(0), . . . ,/ (n) (0) exist, but f n) is not continuous at 0; if 



/(*) 



k 0, a: = 0, 



then/'(0), . . . ,/ (n) (0) exist, and ^discontinuous at 0, but f n) is not differ- 
entiable at 0. These examples may suggest that "reasonable" functions can be 
characterized by the possession of higher-order derivatives — no matter how 
hard we try to mask the infinite oscillation of f(x) = sin 1 /x, a derivative of 
sufficiently high order seems able to reveal the underlying irregularity. Un- 
fortunately, we will see later that much worse things can happen. 

After all these involved calculations, we will bring this chapter to a close 
with a minor remark. It is often tempting, and seems more elegant, to write 
some of the theorems in this chapter as equations about functions, rather than 
about their values. Thus Theorem 3 might be written 

(/+£)'=/' + g', 

Theorem 4 might be written as 

(/•£)' -/•*'+/•*, 

and Theorem 9 often appears in the form 

(fog)' = <f'g)-g'. 

Strictly speaking, these equations may be false, because the functions on the 
left-hand side might have a larger domain than those on the right. Neverthe- 
less, this is hardly worth worrying about. If / and g are differentiable every- 
where in their domains, then these equations, and others like them, are true, 
and this is the only case any one cares about. 
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PROBLEMS 

1. As a warm up exercise, find/'fV) for each of the following/. (Don't worry- 
about the domain of for /'; just get a formula for f(x) that gives the right 
answer when it makes sense.) 

(i) /(*) = sin(* + x 2 ). 

(ii) f{x) = sin x + sin x 2 . 

(iii) f{x) = sin (cos x). 

(iv) f(x) — sin (sin x). 



(v) /W =sin( C -^i). 

sin (cos x) 



(vi) /to 

X 

(vii) /(a:) = sin(* + sin x). 

(viii) f(x) = sin (cos (sin x)). 

Find f(x) for each of the following functions /. (It took the author 20 
minutes to compute the derivatives for the answer section, and it should 
not take you much longer. Although rapid calculation is not the goal of 
mathematics, if you hope to treat theoretical applications of the Chain 
Rule with aplomb, these concrete applications should be child's play — 
mathematicians like to pretend that they can't even add, but most of 
them can when they have to.) 

sin((* + l)\x + 2)). 
sin 3 (# 2 + sin x). 
sin 2 ((# + sin x) 2 ). 



(i) 


/to 


(ii) 


/(*) 


(iii) 


/(*) 


(iv) 


/CO 


(v) 


/(*) 


(vi) 


/(*) 


(vii) 


/to 


(viii) 


/to 


(ix) 


/to 


(x) 


/to 


(xi) 


/to 


(xii) 


/to 


(xiii) 


/to 


(xiv) 


/to 


(XV) 


/to 


(xvi) 


/to 



= sin (~^—\ 

\COS X 3 / 



sin(x sin x) + sin (sin x 2 ). 
(cos*) 31 '. 

sin 2 x sin x 2 sin 2 x 2 . 
sin 3 (sin 2 (sin x)). 
(x + sin 5 #) 6 . 
sin (sin (sin (sin (sin x)))). 
sin((sin 7 x 1 + l) 7 ). 
(((^ + ^) 3 + ^ 4 + ^) 5 . 
sin(# 2 + sin (a; 2 + sin x 2 )). 
sin (6 cos (6 sin (6 cos 6x))). 



1 + sin x 
1 



x + sin x 
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(xvii) /(*) 



(xviii) /(*) 



3. Find the derivatives of the functions tan, cotan, sec, and cosec. (You 
don't have to memorize these formulas, although they will be needed 
once in a while; if you express your answers in the right way, they will be 
simple and somewhat symmetrical.) 

4. For each of the following functions /, find f(f(x)) (not (/•/)'(*))■ 

(i) /(*) = — j-. 

1 + x 

(ii) f(x) — sin x. 
(hi) f(x) = x\ 
(iv) f{x) = 17. 

5. For each of the following functions /, find f(f(x)). 

(i) /(*) = -• 

X 

(ii) fix) = x\ 

(iii) fix) = 17. 

(iv) fix) = 17*. 

6. Find /' in terms of g' if 

(0 fix) =g(x+g(a)). 

(ii) fix) =g(x-g(a)). 

(iii) fix) =gix + gix)). 

(iv) fix) =g(x)(x-a). 

(v) fix) = g(a)(x-a). 

(vi) /(* + 3) = gix>). 

7. (a) A circular object is increasing in size in some unspecified manner, 

but it is known that when the radius is 6, the rate of change of the 
radius is 4. Find the rate of change of the area when the radius is 6. 
(If r(0 and A(t) represent the radius and the area at time t, then the 
functions r and A satisfy A = rr 2 ; a straightforward use of the Chain 
Rule is called for.) 
(b) Suppose that we are now informed that the circular object we have 
been watching is really the cross section of a spherical object. Find 
the rate of change of the volume when the radius is 6. (You will clearly 
need to know a formula for the volume of a sphere; in case you have 
forgotten, the volume is ^tt times the cube of the radius.) 




Differentiation 159 



(c) Now suppose that the rate of change of the area of the circular 
cross section is 5 when the radius is 3. Find the rate of change of the 
volume when the radius is 3. You should be able to do this problem 
in two ways: first, by using the formulas for the area and volume in 
terms of the radius; and then by expressing the volume in terms of 
the area (to use this method you will need Problem 9-3). 

8. Let /(*) = x 2 sin 1 fx for x ^ 0, and let /(0) = 0. Suppose also that h and 
k are two functions such that 

h'{x) = sin 2 (sin(* + 1)) *'(*) = /(* + 1) 
A(0) = 3 k(0) = 0. 

Find 

(i) (/oA)'(0). 

(ii) (W)'(O). 

(iii) a'O 2 ), where a(x) = h(x 2 ). Exercise great care. 

9. Find /'(0) if 



and 

10. Using the derivative of /(*) = 1/x, as found in Problem 9-1, find 
(l/g)'(x) by the Chain Rule. 

11. (a) Using Problem 9-3, find /'(*) for -1 < x < 1, if fix) = V} - x 2 . 
(b) Prove that the tangent line to the graph of / at (a, y/\ — a 2 ) inter- 
sects the graph only at that point (and thus show that the elementary 
geometry definition of the tangent line coincides with ours). 

12. Prove similarly that the tangent lines to an ellipse or hyperbola intersect 
these sets only once. 

13. If / + g is differentiable at a, are / and g necessarily differentiable at a ? 
If / • g and / are differentiable at a, what conditions on / imply that g is 
differentiable at a ? 

14. (a) Prove that if / is differentiable at a, then |/| is also differentiable at a, 

provided that f(a) ^ 0. 

(b) Give a counterexample if f(a) = 0. 

(c) Prove that if / and g are differentiable at a, then the functions 
max(/, g) and min(/, g) are differentiable at a, provided that 
f(a) * g(a). 

(d) Give a counterexample if f(a) = g(a). 

15. Suppose that f n) (a) and g {n) (a) exist. Prove Leibniz's formula: 



\ | g(x) sin -> x 9* 0 
f(x) = \ x 

I 0, x = 0, 

*(0) = s'(0) - 0. 
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*16. Prove that if frigid)) and £ (n) 0) both exist, then (/ o gY n \a) exists. A 
little experimentation should convince you that it is unwise to seek a 
formula for (f ° g) (n) (a). In order to prove that (f°g) (n) (a) exists you 
will therefore have to devise a reasonable assertion about (f°g) {n) (a) 
which can be proved by induction. Try something like: "(/°£) n (<z) 
exists and is a sum of terms each of which is a product of terms of the 
form 

17. (a) If f(x) = a n x n + a n -\x n ~ l + • • • + a 0 , find a function g such that 

g r = /. Find another. 

(b) If 

r, \ b 2 . b 3 b m 
fix) = - + — + • • • + — i 
x 2 x* x m 

find a function g with g' = f. 

(c) Is there a function 

/(*) = a n x« + • - • + a Q + - + • • • + ^ 

a: # 

such that /'(*) = 1 fx ? 

18. Show that there is a polynomial function / of degree n such that 

(a) f(x) = 0 for precisely n — 1 numbers *. 

(b) /'(#) = 0 for no x y if n is odd. 

( c ) /'(*) = 0 for exactly one x, if w is even. 

(d) f(x) = 0 for exactly k numbers x, if n — k is odd. 

19. (a) The number a is called a double root of the polynomial function / 

if fix) = (x — fl) 2 ^*) for some polynomial function £. Prove that 
a is a double root of / if and only if a is a root of both / and /'. 
(b) When does fix) = ax 2 + bx + c {a ^ 0) have a double root? What 
does the condition say geometrically? 

20. If / is differentiable at a, let d(x) = f(x) - f'(a)(x - a) - /(a). Find 

(a). In connection with Problem 19, this gives another solution for 
Problem 9-20. 

*21. This problem is a companion to Problem 3-6. Let a\, . . . , a n and 
£i, . . . , b n be given numbers. 

(a) If #i, ... , x n are distinct numbers, prove that there is a polynomial 
function / of degree In — 1, such that f(x 3 ) = fix 3 ) = 0 for / 5^ i, 
and f(xi). = di and /'(#») = b{. Hint: Remember Problem 19. 

(b) Prove that there is a polynomial function / of degree In — 1 with 
/(*,•) = 0; and f'ixi) = for all i. 

*22. Suppose that a and b are two consecutive roots of a polynomial function 
/, but that a and b are not double roots, so that we can write fix) = 
(* — a) ix — b)g{x) where ^(a) 0 and 5^ 0. 
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(a) Prove that g{a) and g(b) have the same sign. (Remember that a and 
b are consecutive roots.) 

(b) Prove that there is some number x with a < x < b and /'(*) = 0. 
(Also draw a picture to illustrate this fact.) Hint: Compare the sign 
of f{a) and f{b). 

(c) Now prove the same fact, even if a and b are multiple roots. Hint: 
If f(a) = (x - a) m (x - £) n £(*) where ^ 0 and g(£) ^ 0, con- 
sider the polynomial function h(x) = f'(x)/(x — a) m ~ l {x — b) n ~ l . 

This theorem was proved by the French mathematician Rolle, in con- 
nection with the problem of approximating roots of polynomials, but the 
result was not originally stated in terms of derivatives. In fact, Rolle was 
one of the mathematicians who never accepted the new notions of calcu- 
lus. This was not such a pigheaded attitude, in view of the fact that for 
one hundred years no one could define limits in terms that did not verge 
on the mystic, but on the whole history has been particularly kind to 
Rolle; his name has become attached to a much more general result, to 
appear in the next chapter, which forms the basis for the most important 
theoretical results of calculus. 
23. Suppose that f(x) = xg(x) for some function g which is continuous at 0. 

Prove that / is differentiable at 0, and find /'(0) in terms of g. 
*24. Suppose / is differentiable at 0, and that /(0) = 0. Prove that f(x) = 
xg(x) for some function g which is continuous at 0. Hint: What happens 
if you try to write g(x) = f(x)/x ? 
25. If /W = x~ n for n in N, prove that 



*26. Prove that it is impossible to write x = f(x)g(x) where / and g are 

differentiable and /(0) = ^(0) = 0. Hint: Differentiate. 
27. What is /<*>(*) if 



*28. Let/W = x 2n sin 1/xifx ^ 0, and let /(0) = 0. Prove that/' (0), . . . , 

f n) (0) exist, and that / (n) is not continuous at 0. (You will encounter the 

same basic difficulty as that in Problem 15.) 
*29. Let f(x) = x 2n+l sin \/x Hx ^ 0, and let /(0) = 0. Prove that /'(0), . . . , 

/ (n) (0) exist, that / (n) is continuous at 0, and that / (n) is not differentiable 

at 0. 



(n + k- 1)! 
(*-D! * 




(a) fix) 
*(b) f(x) 



l/(* - a) n ? 
l/(* 2 - 1) ? 
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30. In Leibnizian notation the Chain Rule ought to read: 



df(g(x)) _ df{y) 



dg{x) 



v~q(x) dx 



dx dy 

Instead, one usually finds the following statement: "Let y = g(x) and 
z = f(y). Then 

dz = dz^dy" 
dx dy dx 

Notice that the z in dz/dx denotes the composite function f ° g, while the 
z in dz/dy denotes the function /; it is also understood that dz/dy will be 
"an expression involving y" and that in the final answer g(x) must be 
substituted for In each of the following cases, find dz/dx by using this 
formula; then compare with Problem 1. 

(i) z — sin y, y = x + x 2 . 

(ii) z = sin y, y = cos x. 

(iii) z — cos u, u = sin x. 

(iv) z = sin v, v — cos u, u = sin x. 



CHAPTER | I SIGNIFICANCE OF THE DERIVATIVE 



One aim in this chapter is to justify the time we have spent learning to find the 
derivative of a function. As we shall see, knowing just a little about/' tells us a 
lot about/. Extracting information about /from information about/' requires 
some difficult work, however, and we shall begin with the one theorem which 
is really easy. 

This theorem is concerned with the maximum value of a function on an 
interval. Although we have used this term informally in Chapter 7, it is worth- 
while to be precise, and also more general. 



DEFINITION 



THEOREM 1 



PROOF 



Let / be a function and A a set of numbers contained in the domain of/. 
A point x in A is a maximum point for / on A, if 

/(*) > f(y) for every y in A. 
The number /(*) itself is called the maximum value of/ on A (and we also 
say that / "has its maximum value on A at x"). 



Notice that the maximum value of / on A could be /(*) for several different x 
(Figure 1); in other words, a function / can have several different maximum 
points on A, although it can have at most one maximum value. Usually we 
shall be interested in the case where A is a closed interval [a, b]\ if / is continu- 
ous, then Theorem 7-3 guarantees that / does indeed have a maximum value 
on [a, b\ 

The definition of a minimum of / on A will be left to you. (One possible 
definition is the following: / has a minimum on A at x, if -/ has a maximum 
on A at x.) ' 

We are now ready for a theorem which does not even depend upon the 

existence of least upper bounds. 

Let / be any function defined on (a, b). If x is a maximum (or a minimum) 
point for / on (a, b), and / is differentiate at *, then /'(*) = 0. 
(Notice that we do not assume differentiability, or even continuity, of / at 
other points.) 

Consider the case where /has a maximum at x. (Figure 2 illustrates the simple 
idea behind the whole argument— secants drawn through points to the left of 
(x, /(*)) have slopes > 0, and secants drawn through points to the right of 
(x[f (x)) have slopes < 0.) Analytically, this argument proceeds as follows. 
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x + h 



FIGURE 2 



FIGURE 3 



DEFINITION 



If h is any number such that x + h is in (a, b), then 

/(*) >f(x + h), 
since / has a maximum on (a, b) at *. This means that 

/(* + A) " /« < 0. 

Thus, if h > 0 we have 

/(* + *) -f(x) 



and consequently 



lim < o. 



On the other hand, if < 0, we have 



so 



/(* + *) -/(*) > n 
h ~ U> 



lim — > 0. 



By hypothesis, / is differentiable at #, so these two limits must be equal, in 
fact equal to /'(*). This means that 

f(x) < 0 and f(x) > 0, 

from which it follows that /'(*) = 0. 

The case where / has a minimum at x is left to you (give a one-line proof). | 

Notice (Figure 3) that we cannot replace {a, b) by [a, b] in the statement of 
the theorem (unless we add to the hypothesis the condition that x is in (a, b)). 

Since f(x) depends only on the values of / near x> it is almost obvious how 
to get a stronger version of Theorem 1 . We begin with a definition which is 
illustrated in Figure 4. 



Let / be a function, and A a set of numbers contained in the domain 
of /. A point x in A is a local maximum [minimum] point for / on A if 
there is some 8 > 0 such that x is a maximum [minimum] point for / on 
A O (* - 8, x + 8). 



theorem 2 If / is defined on (a, b) and has a local maximum (or minimum) at x, and / is 
differentiable at x, then /'(*) = 0. 

PROOF You should see why this is an easy application of Theorem 1 . | 
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The converse of Theorem 2 is definitely not true — it is possible for /'(#) to 
be 0 even if x is not a local maximum or minimum point for /. The simplest 
example is provided by the function /(*) = * 3 ; in this case f(0) = 0, but /has 
no local maximum or minimum anywhere. 

Probably the most widespread misconceptions about calculus are concerned 
with the behavior of a function /near x when f(x) = 0. The point made in the 
previous paragraph is so quickly forgotten by those who want the world to 
be simpler than it is, that we will repeat it: the converse of Theorem 2 is not 
true — the condition /'(*) = 0 does not imply that x is a local maximum or 
minimum point of /. Precisely for this reason, special terminology has been 
adopted to describe numbers x which satisfy the condition /'(*) = 0. 



DEFINITION 



A critical point of a function / is a number x such that 

f(x) = 0. 

The number /(*) itself is called a critical value of /. 




a local 
minimum point 



*2 

a local 
maximum point 



FIGURE 4 



The critical values of /, together with a few other numbers, turn out to be 
the ones which must be considered in order to find the maximum and mini- 
mum of a given function /. To the uninitiated, finding the maximum and 
minimum value of a function represents one of the most intriguing aspects of 
calculus, and there is no denying that problems of this sort are fun (until you 
have done your first hundred or so). 

Let us consider first the problem of finding the maximum or minimum of/ 
on a closed interval [a, b]. (Then, if / is continuous, we can at least be sure 
that a maximum and minimum value exist.) In order to locate the maximum 
and minimum of / three kinds of points must be considered: 

(1) The critical points of / in [a, b\ 

(2) The end points a and b. 

(3) Points x in [a, b] such that / is not differentiable at x. 

If x is a maximum point or a minimum point for / on [a, b], then x must be 
in one of the three classes listed above: for if x is not in the second or third 
group, then x is in (a, b) and / is differentiable at x; consequently /'(*) = 0, 
by Theorem 1, and this means that x is in the first group. 

If there are many points in these three categories, finding the maximum and 
minimum of / may still be a hopeless proposition, but when there are only a 
few critical points, and only a few points where / is not differentiable, the 
procedure is fairly straightforward: one simply finds /(*) for each x satisfying 
/'(*) = 0, and/(;t) for each x such that / is not differentiable at x and, finally, 
f(a) and f(b). The biggest of these will be the maximum value of /, and the 
smallest will be the minimum. A simple example follows. 



Suppose we wish to find the maximum and minimum value of the function 



/(*) = x z — x 

on the interval [—1, 2]. To begin with, we have 

f(x) = 3*' - 1, 

so /'(*) = 0 when 3* 2 - 1 = 0, that is, when 

x = VT73 or - VT/3. 

The numbers Vl/3 and — Vl/3 both lie in [ — 1, 2], so the first group of 
candidates for the location of the maximum and the minimum is 

(i) Via - V173. 

The second group contains the end points of the interval 

(2) -1,2. 

The third group is empty, since / is differentiate everywhere. The final step 
is to compute 

/(VT/3) = (VT/3)» - VT/3 = i VT73 - VI73 = -I VT73, 
/(- Vl/3) = (- V173) 3 - (- VT73) = -iVT/3 + VI73 = f VT73, 
/(-i) = 0, 

/(2) = 6. 

Clearly the minimum value is — f Vl/3, occurring at VT/3, and the maxi- 
mum value is 6, occurring at 2. 

This sort of procedure, if feasible, will always locate the maximum and 
minimum value of a continuous function on a closed interval. If the function 
we are dealing with is not continuous, however, or if we are seeking the maxi- 
mum or minimum on an open interval or the whole line, then we cannot even 
be sure beforehand that the maximum and minimum values exist, so all the 
information obtained by this procedure may say nothing. Nevertheless, a 
little ingenuity will often reveal the nature of things. In Chapter 7 we solved 
just such a problem when we showed that if n is even, then the function 

f( x ) =x* + a n ^x n - 1 + • • • + a 0 

has a minimum value on the whole line. This proves that the minimum value 
must occur at some number x satisfying 

0 = f(x) = nx n ~ l + (n - \)a n ^x n ^ + • • • + a Q . 

If we can solve this equation, and compare the values of f(x) for such x, we 
can actually find the minimum of /. One more example may be helpful. Sup- 
pose we wish to find the maximum and minimum, if they exist, of the function 
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on the open interval (-1, 1). We have 

2x 



/'(*) = 



(1 - * 2 ) 2 

so/'(x) = 0 only for x = O.We can see immediately that for x close to 1 or — 1 
the values of /(*) become arbitrarily large, so /certainly does not have a maxi- 
mum. This observation also makes it easy to show that / has a minimum at 0. 
We just note (Figure 5) that there will be numbers a and b, with 

-1 < a < 0 and 0 < b < 1, 
such that /(*) > /(0) for 

— 1 < x < a and b < x < 1. 

This means that the minimum of / on [a, b] is the minimum of / on all of 
(-1,1). Now on |>, b] the minimum occurs either at 0 (the only place where 
/' = 0), or at a or b, and a and £ have already been ruled out, so the minimum 
value is/(0) = 1. _ 

In solving these problems we purposely did not draw the graphs of f(x) - 
x z - x and /(*) = 1/(1 - * 2 ), but it is not cheating to draw the graph 
(Figure 6) as long as you do not rely solely on your picture to prove anything. 
As a matter of fact, we are now going to discuss a method of sketching the 
graph of a function that really gives enough information to be used in discuss- 
ing maxima and minima— in fact we will be able to locate even local maxima 
and minima. This method involves consideration of the sign of/'(x), and relies 
on some deep theorems. 

The theorems about derivatives which have been proved so far, always 
yield information about/' in terms of information about /. This is true even 
of Theorem 1, although this theorem can sometimes be used to determine 
certain information about /, namely, the location of maxima and minima. 
When the derivative was first introduced, we emphasized that /'(*) is not 
[f( x + h) - f(x)]/h for any particular h, but only a limit of these numbers as h 
approaches 0; this fact becomes painfully relevant when one tries to extract 
information about / from information about /'. The simplest and most frus- 
trating illustration of the difficulties encountered is afforded by the following 
question: If /'(*) = 0 for all x y must*/ be a constant function? It is impossible 
to imagine how / could be anything else, and this conviction is strengthened 
by considering the physical interpretation— if the velocity of a particle is 
always 0, surely the particle must be standing still! Nevertheless it is difficult 
even to begin a proof that only the constant functions satisfy fix) = 0 for all 
x. The hypothesis /'(*) = 0 only means that 

lim /(* + *)-/(*) = 0> 

h-+o h 

and it is not at all obvious how one can use the information about the limit to 
derive information about the function. 
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The fact that / is a constant function if /'(*) = 0 for all x, and many other 
facts of the same sort, can all be derived from a fundamental theorem, called 
the Mean Value Theorem, which states much stronger results. Figure 7 makes 
it plausible that if/ is differentiable on [a, b], then there is some x in (a, b) such 
that 



/'(*) 



Kb) ~f(a) 



FIGURE 7 



Geometrically this means that some tangent line is parallel to the line between 
(a,f(a)) and (b,f(b)). The Mean Value Theorem asserts that this is true — 
there is some x in (a, b) such that /'(*), the instantaneous rate of change of/ at 
x, is exactly equal to the average or "mean" change of / on [a, b], this average 
change being [f(b) - f(a)]/[b - a]. (For example, if you travel 60 miles in 
one hour, then at some time you must have been traveling exactly 60 miles per 
hour.) This theorem is one of the most important theoretical tools of calculus — 
probably the deepest result about derivatives. From this statement you might 
conclude that the proof is difficult, but there you would be wrong — the hard 
theorems in this book have occurred long ago, in Chapter 7. It is true that if 
you try to prove the Mean Value Theorem yourself you will probably fail, 
but this is neither evidence that the theorem is hard, nor something to be 
ashamed of. The first proof of the theorem was an achievement, but today we 
can supply a proof which is quite simple. It helps to begin with a very special 
case. 

THEOREM 3 (ROLLE'S THEOREM) If / is continuous on [a, b] and differentiable on (a, b), and f(a) = f(b), then 

there is a number x in (a, b) such that/'(*) = 0. 



FIGURE 8 



PROOF 



FIGURE 9 



FIGURE 10 



It follows from the continuity of / on [a, b] that / has a maximum and a mini- 
mum value on [a, b]. 

Suppose first that the maximum value occurs at a point x in (a, b). Then 
f(x) = 0 by Theorem 1, and we are done (Figure 8). 

Suppose next that the minimum value of / occurs at some point x in (a, b). 
Then, again, /'(*) = 0 by Theorem 1 (Figure 9). 

Finally, suppose the maximum and minimum values both occur at the end 
points. Since f(a) = f(b), the maximum and minimum values of / are equal, 
so / is a constant function (Figure 10), and for a constant function we can 
choose any x in (a, b). | 

Notice that we really needed the hypothesis that / is differentiable every- 
where on (a, b) in order to apply Theorem 1 . Without this assumption the 
theorem is false (Figure 11). 

You may wonder why a special name should be attached to a theorem as 
easily proved as Rolle's Theorem. The reason is, that although Rolle's 
Theorem is a special case of the Mean Value Theorem, it also yields a simple 
proof of the Mean Value Theorem. In order to prove the Mean Value 



Significance of the Derivative 169 




Theorem we will apply Rolle's Theorem to the function which gives the length 
of the vertical segment shown in Figure 12; this is the difference between /(#), 
and the height at x of the line L between (a, f(a)) and (b, f{b)). Since L is the 
graph of 



we want to look at 



FIGURE 11 



THEOREM 4 (THE MEAN VALUE 



As it turns out, the constant f(a) is irrelevant. 

If / is continuous on [a, b] and differentiate on (a, b), then there is a number 



(a, /(*))' 



FIGURE 12 



THEOREM) j in such that 



/'« = 



/(*) -/(«) . 

6 - a 



proof Let 




'(*, /(*)) 



Clearly, A is continuous on [a, b] and differentiable on (a, b), and 

= /(*), 

AW=/w _[/_M] (4 _ a) 
= /(«)• 

Consequently, we may apply Rolle's Theorem to h and conclude that there is 
some x in (a, b) such that 

/(*) -/(«) 



so that 



o = *'(*) = /'(*) - 

/'(*) = 



b — a 

fib) -f(a) 



b — a 



I 



Notice that the Mean Value Theorem still fits into the pattern exhibited by 
previous theorems — information about / yields information about /'. This 
information is so strong, however, that we can now go in the other direction. 

corollary l If / is defined on an interval and /'(*) = 0 for all x in the interval, then /is 
constant on the interval. 



PROOF Let a and b be any two points in the interval with a 9^ b. Then there is some x 
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FIGURE 13 



COROLLARY 2 



PROOF 



DEFINITION 



COROLLARY 3 



PROOF 



in (a> b) such that 

m = &L=M. 

b — a 

But f(x) = 0 for all x in the interval, so 

o _ /(*)- /GO 

and consequently /(#) = /(£). Thus the value of / at any two points in the 
interval is the same, i.e., / is constant on the interval. | 

Naturally, Corollary 1 does not hold for functions defined on two or more 
intervals (Figure 13). 

If / and g are defined on the same interval, and /'(*) = g'(x) for all x in the 
interval, then there is some number c such that / = g + c. 

For all x in the interval we have (/ — g)'(x) = /'(*) — g'(x) — 0 so, by 
Corollary 1, there is a number c such that / — g = c. | 

The statement of the next corollary requires some terminology, which is 
illustrated in Figure 14. 



A function / is increasing on an interval if f(a) < f(b) whenever a and b 
are two numbers in the interval with a < b. The function / is decreasing 
on an interval if f(a) > f(b) for all a and b in the interval with a < b. (We 
often say simply that / is increasing or decreasing, in which case the interval 
is understood to be the domain of /.) 



If /'(*) > 0 for all x in an interval, then / is increasing on the interval; if 
/'(*) < 0 for all x in the interval, then / is decreasing on the interval. 

Consider the case where /'(*) > 0. Let a and b be two points in the interval 
with a < b. Then there is some x in (a, b) with 

b — a 

But f(x) > 0 for all x in (a, b), so 

fW ~f(a) > Q 
b — a 

Since b — a > 0 it follows that f(b) > f(a). 

The proof when /'(#) < 0 for all * is left to you. | 
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(a) an increasing function 




(b) a decreasing function 
FIGURE 14 



Notice that although the converses of Corollary 1 and Corollary 2 are true 
(and obvious), the converse of Corollary 3 is not true. If/ is increasing, it is 
easy to see that /'(*) > 0 for all *, but the equality sign might hold for some x 
(consider /W = x 3 ). 

Corollary 3 provides enough information to get a good idea of the graph ot 
a function with a minimal amount of point plotting. Consider, once more, the 
function /(*) = x* - x. We have 

/'(*) = 3x 2 — 1. 

We have already noted that /'(*) = 0 for x = Vl/3 and x = -Vl/3, and 
it is also possible to determine the sign of /'(*) for all other x. Note that 
3x 2 — 1 > 0 precisely when 

3x 2 > 1, 
x*>h 

x > VI73 or x < - VT73; 
thus 3* 2 — 1 < 0 precisely when 

- VT73 < x < Via 

Thus / is increasing for x < - V 1/3, decreasing between - VV3 and 
Vl73, and once again increasing for x > V 1/3. Combining this information 
with the following facts 

(1) /(- Vi/3) = f VTT^ 

/(Vl/3) = -f Vl/3, 

(2) f(x) = 0 for x = -1, 0, 1, 

(3) /(*) gets large as x gets large, and large negative as x gets large 
negative, 

it is possible to sketch a pretty respectable approximation to the graph 
(Figure 15). 

By the way, notice that the intervals on which / increases and decreases 
could have been found without even bothering to examinejhe sign off. For 
example, since/' is continuous, and vanishes only at - Vl/3 and Vl/3, we 
know that/' always has the same sign on the interval (-Vl/3, Vl/3). Since 
y(_VT73) > /(VT73), it follows that / decreases on this interval. Similarly, 
/' always has the same signon (VlA 00) and /(*) is large for large x, so / 
must be increasing on (Vl/3, 00). Another point worth noting: If/' is con- 
tinuous, then the sign of/' on the interval between two adjacent critical points 
can be determined simply by finding the sign of /'(*) for any one x in this 
interval. 

Our sketch of the graph of /(*) = x* -^contains sufficient information to 
allow us to say with confidence that - Vl/3 is a local maximum point, and 
VT/3 a local minimum point. In fact, we can give a general scheme for 
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deciding whether a critical point is a local maximum point, a local minimum 
point, or neither (Figure 1 6) : 

(1) if/' > 0 in some interval to the left of x and /' < 0 in some interval 
to the right of x, then x is a local maximum point. 

(2) if/' < 0 in some interval to the left of x and /' > 0 in some interval 
to the right of x, then x is a local minimum point. 

(3) if/' has the same sign in some interval to the left of x as it has in some 
interval to the right, then x is neither a local maximum nor a local 
minimum point. 

(There is no point in memorizing these rules — you can always draw the pic- 
tures yourself.) 

The polynomial functions can all be analyzed in this way, and it is even 
possible to describe the general form of the graph of such functions. To begin, 




fig 



URE 16 
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we need a result already mentioned in Problem 3-7: If 

f{x) = a n x n + a n -ix n ~ l + • • • + fl 0 , 

then / has at most w "roots," i.e., there are at most n numbers x such that 
fx) = 0. Although this is really an algebraic theorem, calculus can be used 
to give an easy proof. Notice that if x\ and x 2 are roots of / (Figure 17), so that 
/Oi) = f(x 2 ) = 0, then by Rolle's Theorem there is a number x between 
X\ and x 2 such that f(x) = 0. This means that if / has k different roots 
xi < x 2 < ' ' ' < x k , then /' has at least k — 1 different roots: one between 
#i and x 2 , one between x 2 and # 3 , etc. It is now easy to prove by induction that 
a polynomial function 

fx) = a n x n + a n -ix n ~ l + ' • " + flo 

has at most n roots : The statement is surely true for n = 1 , and if we assume 
that it is true for n, then the polynomial 

g(x) = £ n+ i* n+1 + b n x n + ' ' ■ + *0 

could not have more than n + 1 roots, since if it did, g' would have more than 
n roots. 

With this information it is not hard to describe the graph of 
f(x) = a n x n + tf n -i* n_1 + ' ' ■ + flo. ' 

The derivative, being a polynomial function of degree n — 1, has at most 
n — 1 roots. Therefore / has at most n — 1 critical points. Of course, a critical 
point is not necessarily a local maximum or minimum point, but at any rate, 
if a and b are adjacent critical points of /, then /' will remain either positive or 
negative on (a, b), since /' is continuous; consequently, / will be either in- 
creasing or decreasing on (a, b). Thus / has at most n regions of decrease or 
increase. 

As a specific example, consider the function 

f( x ) = x A - 2x\ 

Since 

f(x) = 4* 3 - 4x = Axix - l)ix + 1), 
the critical points of / are — 1, 0, and 1, and 

/(-I) = "I, 
/(0) = 0, 
/(I) = "I. 

The behavior of / on the intervals between the critical points can be deter- 
mined by one of the methods mentioned before. In particular, we could deter- 
mine the sign of /' on these intervals simply by examining the formula for fix). 
On the other hand, from the three critical values alone we can see (Figure 18) 
that / increases on ( — 1, 0) and decreases on (0, 1). To determine the sign of 
f on —1) and (1, oo) we can compute 



ft-!) = 4-(-2) 3 -4-(-2) = -24, 
f(2) = 4 • 2 3 - 4 • 2 = 24, 



and conclude that / is decreasing on (-qo, —1) and increasing on (1, <*>). 
These conclusions also follow from the fact that /(*) is large for large x and for 
large negative x. 

We can already produce a good sketch of the graph; two other pieces of 
information provide the finishing touches (Figure 19). First, it is easy to deter- 
mine that f(x) = 0 for x = 0, ; second, it is clear that / is even, f(x) = 
/(— x), so the graph is symmetric with respect to the vertical axis. The function 
f(x) = x 3 — x, already sketched in Figure 15, is odd, /(*) = —/(—*), and is 
consequently symmetric with respect to the origin. Half the work of graph 
sketching may be saved by noticing these things in the beginning. 

Several problems in this and succeeding chapters ask you to sketch the 
graphs of functions. In each case you should determine 

(1) the critical points of/, 

(2) the value of / at the critical points, 

(3) the sign of /' in the regions between critical points (if this is not 
already clear), 

(4) the numbers x such that f(x) = 0 (if possible), 

(5) the behavior of f(x) as x becomes large or large negative (if possible). 

Finally, bear in mind that a quick check, to see whether the function is odd or 
even, may save a lot of work. 

This sort of analysis, if performed with care, will usually reveal the basic 
shape of the graph, but sometimes there are special features which require a 
little more thought. It is impossible to anticipate all of these, but one piece of 
information is often very important. If / is not defined at certain points (for 
example, if / is a rational function whose denominator vanishes at some 
points), then the behavior of /near these points should be determined. 

For example, consider the function 



/(*) = 



- 2* + 2 
x - 1 




AV2, 0) 

(1, -1) 



ff(x) = x* - 2x 2 



(-1, -1) 



FIGURE 19 
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which is not defined at 1. We have 



/'(*) = 



(x - l)(2s - 2) - (x» - 2x + 2) 



*(« - 2) 
(* - I) 2 



(* - I) 2 



Thus 

Moreover, 



(1) the critical points of / are 0, 2. 



(2) /(0) = -2, 
/(2) = 2. 

Because / is not denned on the whole interval (0, 2), the sign of/' must be 
determined separately on the intervals (0, 1) and (1,2), as well as on the 
intervals (- oo, 0) and (2, oo). We can do this by picking particular points in 
each of these intervals, or simply by staring hard at the formula for /'. Either 
way we find that 

(3) /'(*) > 0 if x < 0, 
/'(*) < 0 if 0 < x < 1, 
f (x). < 0 if 1 < x < 2, 
/'(*) > 0 if 2 < x. 

Finally, we must determine the behavior of /(*) as x becomes large or large 
negative, as well as when x approaches 1 (this information will also give us 
another way to determine the regions on which / increases and decreases). 
To examine the behavior as x becomes large we write 

* 2 -2* + 2 . , 1 

= x — 1 + 



X I i 

x — 1 x - 1 

clearly /(*) is close to x - 1 (and slightly larger) when x is large, and fx) is 
close to x - 1 (but slightly smaller) when x is large negative. The behavior 
of / near 1 is also easy to determine; since 

lim (x 2 -2x + 2) = 1^0, 

the fraction 

x 2 - 2x + 2 
x - 1 

becomes large as x approaches 1 from above and large negative as x approaches 
1 from below. 

All this information may seem a bit overwhelming; but there is only one 
way that it can be pieced together (Figure 20); be sure that you can account 
for each feature of the graph. 

When this sketch has been completed, we might note that it looks like the 



176 Derivatives and Integrals 




FIGURE 20 



graph of an odd function shoved over 1 unit, and the expression 
x 2 - 2x + 2 (x - l) 2 + 1 



x - 1 



x - 1 



shows that this is indeed the case. However, this is one of those special features 
which should be investigated only after you have used the other information 
to get a good idea of the appearance of the graph. 

Although the location of local maxima and minima of a function is always 
revealed by a detailed sketch of its graph, it is usually unnecessary to do so 
much work. There is a popular test for local maxima and minima which 
depends on the behavior of the function only at its critical points. 

theorem 5 Suppose /'(a) = 0. If f'{a) > 0, then /has a local minimum at a; if /"(a) < 0, 
then / has a local maximum at a. 



PROOF By definition, 

/» = umtk±A^m. 

h-^o h 
Since f(a) = 0, this can be written 

/>)=i im ^. 

fc->o h 

Suppose now that f f (a) > 0. Then f(a + h)/h must be positive for sufficiently 
small h. Therefore: 
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\/{x) = -x* 



(a) 




(b) 



/(*) - * B 



(c) 

FIGURE 21 



f(a + h) must be positive for sufficiently small h > 0 
and f'(a + h) must be negative for sufficiently small h < 0. 

This means (Corollary 3) that / is increasing in some interval to the right of 
a and /is decreasing in some interval to the left of a. Consequently, / has a local 
minimum at a. 

The proof for the case f'ia) < 0 is similar. | 

Theorem 5 may be applied to the function fx) = * 3 - *, which has already 
been considered. We have 

/'(*) = 3x 2 - 1 
/"(*) = 6*. 

At the critical points, - Vl/3 and Vl/3, we have 

/"(- Vl/3) = -6 VT/3 < 0, 
/"(Vl/3) = 6 Vl/3 > 0. 

Consequently, - Vl/3 is a local maximum point and Vl/3 is a local mini- 
mum point. 

Although Theorem 5 will be found quite useful for polynomial functions, 
the second derivative of many functions is so complicated that it is easier to 
consider the sign of the first derivative. Moreover, if a is a critical point of / it 
may happen that f'ia) = 0. In this case, Theorem 5 provides no information: 
it is possible that a is a local maximum point, a local minimum point, or 
neither, as shown (Figure 21) by the functions 

/« = ~x\ f{x) = x\ fix) = x*; 

in each case/'(0) = /"(0) = 0, but 0 is a local maximum point for the first, a 
local minimum point for the second, and neither a local maximum nor mini- 
mum point for the third. This point will be pursued further in Part IV. 

It is interesting to note that Theorem 5 automatically proves a partial con- 
verse of itself. 

THEOREM 6 Suppose }"ia) exists. If / has a local minimum at a, then f'ia) > 0; if / has a 
local maximum at a, then f'ia) < 0. 

PROOF Suppose / has a local minimum at a. If f'ia) < 0, then / would also have a 
local maximum at a, by Theorem 5. Thus /would be constant in some interval 
containing a, so that f'ia) = 0, a contradiction. Thus we must have f'ia) > 0. 
The case of a local maximum is handled similarly. | 

(This partial converse to Theorem 5 is the best we can hope for: the > 
and < signs cannot be replaced by > and <, as shown by the functions 
fix) = x* and /(*) = -* 4 .) 

The remainder of this chapter deals, not with graph sketching, or maxima 
and minima, but with three consequences of the Mean Value Theorem. The 
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first is a simple, but very beautiful, theorem which plays an important role in 
Chapter 1 5, and which also sheds light on many examples which have occurred 
in previous chapters. 

theorem 7 Suppose that / is continuous at a, and that f'(x) exists for all x in some interval 
containing a, except perhaps for x = a. Suppose, moreover, that lim f'(x) 

x—>a 

exists. Then f(a) also exists, and 

f{a) = lim /'(*). 



PROOF By definition, 



f{d) = lim 



f{a + h) -f(a) 




FIGURE 22 



THEOREM 8 (THE CAUCHY MEAN 
VALUE THEOREM) 



For sufficiently small h > 0 the function / will be continuous on [a, a + h] and 
differentiable on (a, a + h) (a similar assertion holds for sufficiently small 
h < 0). By the Mean Value Theorem there is a number a h in (a, a + h) such 
that 

fia + k) -/W =/W 
h 

Now a h approaches a as h approaches 0, because a h is in («, a + h) ; since 
lim /'(*) exists, it follows that 

/'(«) = lim /(a + A) ~ /(a) = lim /'(a*) = lim /'(*). 



^0 



(It is a good idea to supply a rigorous e-5 argument for this final step, which 
we have treated somewhat informally.) | 

Even if / is an everywhere differentiable function, it is still possible for /' to 
be discontinuous. This happens, for example, if 

„ x ( x 2 sin -> x 9* 0 
fix) = ^ * 

I 0, a: = 0. 

According to Theorem 7, however, the graph of /' can never exhibit a discon- 
tinuity of the type shown in Figure 22. Problem 39 outlines the proof of another 
beautiful theorem which gives further information about the function /'. 

The next theorem, a generalization of the Mean Value Theorem, is of 
interest mainly because of its applications. 

If / and g are continuous on [a, b] and differentiable on (a, b), then there is a 
number x in (a, b) such that 

[fib) ~fia)]g'ix) = [gib) - g(a)]f(x). 



PROOF 
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(If gib) 9* g(a), and g'(x) ^ 0, this equation can be written 

fib) -fja) _fjx) 
g{b)-g{a) g\x) 

Notice that if g{x) = x for all x, then g'(x) = 1, and we obtain the Mean 
Value Theorem. On the other hand, applying the Mean Value Theorem to/ 
and g separately, we find that there are x and y in (<z, b) with 

M - M _ /'(*). 

g(b)~g(a) g'iyY 

but there is no guarantee that the x and y found in this way will be equal. 
These remarks may suggest that the Cauchy Mean Value Theorem will be 
quite difficult to prove, but actually the simplest of tricks suffices.) 

Let 

h(x) =f{x)[g{b) - g(a)} - g(x)[f(b) -f(a)]. 

Then h is continuous on [a, b\ differentiate on (a, b), and 

h(a) =f(a)g(b) -g(a)f(b) = h(b). 

It follows from Rolle's Theorem that h\x) = 0 for some x in (a, b), which 
means that 

0 = f(x)[g(b) - g(a)] - g'(x)[f(b) - (a)]. | 

The Cauchy Mean Value Theorem is the basic tool needed to prove a 
theorem which facilitates evaluation of limits of the form 

M 



Km- 

x^a g{x) 



when 



lim f(x) = 0 and lim gix) = 0. 



In this case, Theorem 5-3 is of no use. Every derivative is a limit of this form, 
and computing derivatives frequently requires a great deal of work. If some 
derivatives are known, however, many limits of this form can now be evalu- 
ated easily. 



theorem 9 (L'HOPITAL'S RULE) Suppose that 



lim f(x) = 0 and lim g(x) = 0, 

x — >a x—*a 

and suppose also that lim /' '(*) / g 1 '(*) exists. Then lim /(*)/$(*) exists, and 

x->a x->a 

hm J — = hm — • 

x-^agix) x^agix) 

(Notice that Theorem 7 is a special case.) 
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PROOF The hypothesis that lim f'{x)/g'{x) exists contains two implicit assumptions: 

(1) there is an interval {a — 8, a + 8) such that /'(*) and g'(x) exist for 
all x in (a — 8, a + 8) except, perhaps, for x = a, 

(2) in this interval g'(x) ^ 0 with, once again, the possible exception of 
x = a. 

On the other hand, / and g are not even assumed to be defined at a. If we 
define f(a) = g(a) = 0 (changing the previous values of f(a) and g(a), if 
necessary), then /and g are continuous at a. If a < x < a + 8, then the Mean 
Value Theorem and the Gauchy Mean Value Theorem apply to / and g on 
the interval [a, x] (and a similar statement holds for a — 8 < x < a). First 
applying the Mean Value Theorem to g, we see that g(x) ^ 0, for if g(x) = 0 
there would be some xi in (a, x) with g'(x{) = 0, contradicting (2). Now 
applying the Cauchy Mean Value Theorem to / and g, we see that there is a 
number a x in (a, x) such that 

[/(*) - 0]g f (a x ) - [g(x) - 0]f(a x ) 

or 

/(*) _ f'(a x ) 

Now a x approaches a as x approaches a, because a x is in (a, x) ; since 
lim f(y)/g'(y) exists, it follows that 

y—>a 

lim M lim f^ lim m. 

(Once again, the reader is invited to supply the details of this part of the 
argument.) | 

PROBLEMS 

1 . For each of the following functions, find the maximum and minimum 
values on the indicated intervals, by finding the points in the interval 
where the derivative is 0, and comparing the values at these points with 
the values at the end points. 

(i) /(*) = x* - x* - Sx + 1 on [-2, 2]. 

(ii) f{x) - * 5 + *+ 1 on [-1, 1]. 
(hi) f(x) = 3* 4 - 8*3 + 6* 2 on [- J, J]. 

(iv) f(x) = 1 — ■ on [-i, 1]. 

X b + X + 1 

(vi) /W = on [0, 5]. 

AT — 1 
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Now sketch the graph of each of the functions in Problem 1 , and find all 
local maximum and minimum points. 

n 

(a) If ai < • • • < a n , find the minimum value of f(x) = ^ (x — ai) 2 . 

i = i 

n 

*(b) Now find the minimum value of f{x) = ^ \x — This is a prob- 

t = i 

lem where calculus won't help at all: on the intervals between the 
en's the function /is linear, so that the minimum clearly occurs at one 
of the ai, and these are precisely the points where / is not differ- 
entiable. However, the answer is easy to find if you consider how 
f(x) changes as you pass from one such interval to another. 
*(c) Let a > 0. Show that the maximum value of 

/<*) = + 1 



i + |*| l + |* - *| 

is (2 + a)/{\ + a). (The derivative can be found on each of the 
intervals (— <x, 0), (0, a), and (a, oo) separately.) 

For each of the following functions, find all local maximum and mini- 
mum points. 

/ x, x 5* 3, 5, 7, 9 

\ 5, x = 3 

(i) fix) = { -3, * - 5 

/ 9, * - 7 

I 7, * = 9. 

/..\ r / x f 0, * irrational 
(n) /(*) = ' / * i 

( 1/?, a: = in lowest terms. 

/• • • \ x/ \ \ x. x rational 
(m) /W = ( 0, x irrational. 

f . v c/ \ ( 1, * = 1/n for some n in N 
(iv) /(*) = { ' 

7 y I 0, otherwise. 

, v /■/ \ __ I 1, if the decimal expansion of x contains a 5 
W JW - | ^ otherwise 

A straight line is drawn from the point (0, a) to the horizontal axis, and 
then back to (1, b)> as in Figure 23. Prove that the total length is shortest 
when the angles a and /3 are equal. (Naturally you must bring a function 
into the picture: express the length in terms of*, where (*, 0) is the point 
on the horizontal axis. The dashed line in Figure 23 suggests an alterna- 
tive geometric proof; in either case the problem can be solved without 
actually finding the point (*, 0).) 



Prove that of all rectangles with given perimeter, the square has the 
greatest area. 



7. Find, among all right circular cylinders of fixed volume V, the one with 
smallest surface area (counting the areas of the faces at top and bottom, 
as in Figure 24). , 

8. Figure 25 shows the graph of the derivative of/. Find all local maximum 
and minimum points of/. 




FIGURE 25 

*9. Suppose that / is a polynomial function, f(x) = x n + a n -ix n ~ l + • • • 
+ 0o, with critical points — 1, 1, 2, 3, 4, and corresponding critical values 
6, 1, 2, 4, 3. Sketch the graph of /, distinguishing the cases n even and n 
odd. 

*10. (a) Suppose that the polynomial function f(x) = x n + a n -ix n ~ l + 

• • • + a 0 has critical points -1, 1,2, 3, and/"(-l) = 0,/"(l) > 0, 
/"(2) < 0, /"(3) = 0. Sketch the graph of/ as accurately as possible 
on the basis of this information. 

(b) Does there exist a polynomial function with the above properties, 
except that 3 is not a critical point? 

11. Describe the graph of a rational function (in very general terms, similar 
to the text's description of the graph of a polynomial function). 

12. (a) Prove that two polynomial functions of degree m and n, respectively, 

intersect in at most max(m, n) points, 
(b) For each m and n exhibit two polynomial functions of degree m and n 
which intersect max(m, n) times. 
*13. (a) Suppose that the polynomial function f(x) = x n + a n -\x n ~~ l + 

• • • + a 0 has exactly k critical points and /"(#) ^ 0 for all critical 
points x. Show that n — k is odd. 

(b) For each n, show that there is a polynomial function / of degree n 
with k critical points if n — k is odd. 

(c) Suppose that the polynomial function f(x) = x n + a n ^\X n " 1 + 

• • • + a 0 has ki local maximum points and k 2 local minimum 
points. Show that k 2 — k Y + 1 if n is even, and k 2 = £i if n is odd. 

(d) Let n, k h k 2 be three integers with k 2 = k\ + 1 if n is even, and 
k% = ki if n is odd, and ki + k 2 < n. Show that there is a polynomial 
function / of degree n, with k\ local maximum points and k 2 local 
minimum points. Hint: Pick a\ < a 2 < • • • < a kl +k t and try 

kl+k2 

f{x) = n ~ a d ' (1 + * 2 )* for an appropriate number /. 
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14. (a) Prove that if /'(*) > M for all x in [a, b], then f{b) > f{a) + 

M(b - a). 

(b) Prove that if/'(*) < m for all x in [a, b], then /(£) < /(*) + - a). 

(c) Formulate a similar theorem when |/(*)| < M for all x in [>, b]. 

15. (a) Suppose that/'(*) > g'(x) for all a:, and that f(a) = g(a). Show that 

/(*) > g(x) for x > a and fix) < g(x) for x < a. 
(b) Show by an example that these conclusions do not follow without 
the hypothesis f(a) = g(a). 

16. Find all functions / such that 

(a) f(x) = sin x. 

(b) /"(*) = x \ 

(c) /'"(*) = x + x\ 

17. Although it is true that a weight dropped from rest will fall s(t) = 16/ 2 
feet after t seconds, this experimental fact does not mention the behavior 
of weights which are thrown upwards or downwards. On the other hand 
the law s"(t) = 32 is always true and has just enough ambiguity to 
account for the behavior of a weight released from any height, with any 
initial velocity. For simplicity let us agree to measure heights upwards 
from ground level; in this case velocities are positive for rising bodies and 
negative for falling bodies, and all bodies fall according to the law 
s"(t) = -32. 

(a) Show that s is of the form s(t) = —l6t 2 + at-\-/3. 

(b) By setting t = 0 in the formula for s, and then in the formula for /, 
show that s(t) = — 16t 2 + v 0 t + s 0 , where s 0 is the height from which 
the body is released at time 0, and v 0 is the velocity with which it is 
released. 

(c) A weight is thrown upwards with velocity v feet per second, at 
ground level. How high will it go? ("How high" means "what is the 
maximum height for all times.") What is its velocity at the moment 
it achieves its greatest height? What is its acceleration at that 
moment? When will it hit the ground again? What will its velocity 
be when it hits the ground again? 

18. A cannon ball is shot from the ground with velocity v at an angle a 
(Figure 26) so that it has a vertical component of velocity v sin a and a 
horizontal component v cos a. Its distance s(t) above the ground obeys 
the law s(t) = — 16t 2 + (v sin a)t 9 while its horizontal velocity remains 
constantly v cos a. 

(a) Show that the path of the cannon ball is a parabola (find the position 
at each time /, and show that these points lie on a parabola). 

(b) Find the angle a which will maximize the horizontal distance 
traveled by the cannon ball before striking the ground. 



*19. (a) Give an example of a function / for which lim f(x) exists, but 

X — ► so 

lim /'(*) does not exist. 

x — » °o 

(b) Prove that if lim /(*) and lim /'(*) both exist, then \imf(x) = 0. 

x— » oo x—* oo a;—* 00 

(c) Prove that if lim /(*) exists and lim /"(*) exists, then lim /"(*) = 0 

X—> 00 X— > W X— ► « 

and also lim f(x) = 0. 

X — » oo 

(d) Generalize this result. 

20. Suppose that / and g are two differ en tiable functions which satisfy 

— fg = 0. Prove that if a and b are adjacent zeros of/, and g(a) and 
g(b) are not both 0, then g(x) = 0 for some * between a and (Natu- 
rally the same result holds with / and g interchanged; thus, the zeros of 
/ and g separate each other.) Hint: Derive a contradiction from the 
assumption that g(x) ^ 0 for all x between a and b: if a number is not 0, 
there is a natural thing to do with it. 

21. Suppose that \f(x) - /O0| < 0 ~ 3>) n for n > 1. Prove that / is con- 
stant by considering /'. Compare with Problem 3-20. 

22. Prove that if 

ao ai a n _ 

— + — -r * ' ' n ; — 7 "* u > 

12 n + 1 

then 

a 0 + aix + • • • + a n * n = 0 

for some # in [0, 1]. 

23. Prove that the polynomial function f m (x) = x* - 3x + m never has two 
roots in [0, 1], no matter what m may be. (This is an easy consequence of 
Rolle's Theorem. It is instructive, after giving an analytic proof, to graph 
f 0 and /i, and consider where the graph of f m lies in relation to them.) 

24. Suppose that / is continuous and differentiable on [0, 1], that /(*) is in 
[0, 1] for each x, and that/'OO * 1 for all x in [0, 1]. Show that there is 
exactly one number x in [0, 1] such that /(*) = x. (Half of this problem 
has been done already, in Problem 7-11.) 

*25. Prove that if/ is a twice differentiable function with /(0) = 0and/(l) = 1 
an d /'(0) = f{\) = 0, then |/"(jc)| > 4 for some x in [0, 1]. In more 
picturesque terms: A particle which travels a unit distance in a unit time, 
and starts and ends with velocity 0, has at some time an acceleration > 4. 
Hint: Prove that either f"(x) > 4 for some x in [0, J], or else /"(*) < 
— 4 for some x in [J, 1]. 
26. Suppose that / is a function such that /'(*) = 1/x for all x > 0 and 
/(l) = 0. Prove that f(xy) = f(x) + /(>) for all x, y > 0. Hint: Find 
/(*) when^W = f(xy). 

*27. Suppose that / satisfies 

/"(*) +f'(x)g(x) -/W = 0 
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for some function g. Prove that if / is 0 at two points, then / is 0 on the 
interval between them. Hint: Use Theorem 6. 

Suppose that / is rc-times differentia ble and that f(x) = 0 for n + 1 
different x. Prove that f {n) (x) = 0 for some x. 



28 

29. Prove that 



i < V66 - 8 < i 
(without computing V66 to 2 decimal places!). 

30. Prove the following slight generalization of the Mean Value Theorem: 
If/ is continuous and differentiable on (a, b) and lim f(y) and lim f(y) 

y — * a + y — *b~ 

exist, then there is some x in (a, b) such that 

lim f(y) - lim f(y) 
b — a 

(Your proof should begin: "This is a trivial consequence of the Mean 
Value Theorem because . . . .") 

31. Prove that the conclusion of the Cauchy Mean Value Theorem can be 
written in the form 

fib) - fjfl) = f(x) 
g(b) -g(a) g'{x) 

under the additional assumptions that g(b) ^ g(a) and that f(x) and 
g'(x) are never simultaneously 0 on (a, b). 

*32. Prove that if/ and g are continuous on [a, b] and differentiable on (a, b), 
and g'(x) ^ 0 for x in (a, b), then there is some x in (a, b) with 

/'(*) _ m ~ fia) 

g'M gW - g(x) 

Hint: Multiply out first, to see what this really says. 

33. What is wrong with the following use of FHopital's Rule: 

x * + x -2 3x* +1 6* , 

hm — — -— = hm = hm — = 3. 

z-i x 2 - 3x + 2 x~>i 2x - 3 2 

(The limit is actually —4.) 

34. Find the following limits: 



(i) lim 



x 



(ii) lim 



*-*o tan x 

cos 2 x — 1 



+0 x* 
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35. Find /'(O) if 



fix) = x 
10, 



i a: 0 
x = 0, 



and 5 (0) = ^(0) - 0 and ^"(O) = 17. 

36. Prove the following forms of l'Hopital's Rule (none requiring any essen- 
tially new reasoning). 

(a) If lim f{x) = lim g(x) = 0, and lim f'(x)/g'(x) = /, then lim 

x—*a + x—*a + x—*a + x— +a + 

f(x)/g(x) = I (and similarly for limits from below). 

(b) If lim fix) = lim g(x) = 0, and lim f(x)/g f (x) = oo, then lim 

x—*a x—*a x—>a x—*a 

f(x)/g(x) = oo (and similarly for — oo s or if x — > a is replaced by 
* — > <z + or x — » <3 - )- 

(c) If lim /(*) = lim - 0 and lim f(x)/g'(x) = /, then lim 

£— ► flO x— » » x— ► oo x— » 00 

f(x)/g(x) = I (and similarly for — oo). Hint: Consider lim 

x-»0 + 

f(l/x)/g(l/x). 

(d) If lim /(*) = lim £(» =0 and lim f'(x)/g'(x) = », then lim 

X—> oo x— » « x—* oo X— ► «0 

fix)/gix) = oo, 

37. There is another form of l'Hopital's Rule which requires more than 
algebraic manipulations: If lim f(x) = lim g(x) = oo, and lim 

X— > oo X—* oo X— > 00 

f(x)/g , (x) = /, then lim f(x)/g(x) = I. Prove this as follows. 

X — ► oo 

(a) For every £ > 0 there is a number a such that 

m 



*'(*) 



- 1 



< s for x > a. 



Apply the Cauchy Mean Value Theorem to /and g on [a, x] to show 
that 

fix) ~ fia) 



g(x) - g(a) 



< £ for x > a. 



(Why can we assume g(x) — g(a) 9^ 0 ?) 
(b) Now write 

f(x) _ f{x) - fja) f(x) g(x) ~ gja) 
gix) gix) -gia) fix) - fia) gix) 

(why can we assume that fix) — fia) ^ 0 for large x ?) and conclude 
that 

/(*) 



*(*) 



- / 



< 2e for sufficiently large x. 
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38. To complete the orgy of variations on l'Hopital's Rule, use Problem 37 
to prove a few more cases of the following general statement (there are so 
many possibilities that you should select just a few, if any, that interest 
you): 

If lim /(*) = lim g{x) = { {and lim f(x)/g'(x) = ( ), then lim 

f(*)/g(x) = ( ). Here [ ] can be a or a + or a~ or oo or - qo , and { } 
can be 0 or co or - oc , and ( ) can be / or oo or — oo . 

*39. (a) Suppose that / is differentiable on [a, b]. Prove that if the minimum 
of/ on is at a, then /'(a) > 0, and if it is at b, then f(b) < 0. 

(One half of the proof of Theorem 1 will go through.) 

(b) Suppose that /'(a) < 0 and fib) > 0. Show that /'(*) = 0 for some x 
in (a, b). Hint: Consider the minimum of /on [a, b]; why must it be 
somewhere in (a, b)? 

(c) Prove that if f(a) <c < f'(b), then /'(*) - c for some x in (a, 3). 
(This result is known as Darboux's Theorem.) Hint: Cook up an 
appropriate function to which part (b) may be applied. 

*40. It is easy to find a function / such that |/| is differentiable but / is not. 
For example, we can choose /(*) = 1 for x rational and f(x) = - 1 for 
x irrational. In this example /is not even continuous, nor is this a mere 
coincidence: Prove that if |/| is differentiable at a, and/ is continuous at 
a, then /is also differentiable at a. Hint: It suffices to consider only a with 
f(a) = 0. Why? In this case, what must \f\'(a) be? 

*41. (a) Let y ^ 0 and let n be even. Prove that x n + y n = (* + y) n only 
when x = 0. Hint: If x 0 n + y n = (* 0 + y) n , apply Rolle's Theorem 
to f(x) = x n +y« - (x + y) n on [0, * 0 ], 
(b) Prove that if y ^ 0 and n is odd, then x n + y n = (x + y) n only if 
x = 0 or x = —y. 

Use the method of Problem 41 to prove that if n is even and f(x) = x n , 
then every tangent line to / intersects / only once. 

Prove even more generally that if / ; is increasing, then every tangent line 
intersects / only once. 

*44. Suppose that/(0) - 0 and f is increasing. Prove that the function g(x) = 
f(x)/x is increasing on (0, oo). Hint: Obviously you should look at g'(x). 
Prove that it is positive by applying the Mean Value Theorem to / on 
the right interval (it will help to remember that the hypothesis /(0) = 0 
is essential, as shown by the function /(*) = 1 -f 

*45. Use derivatives to prove that if n > 1, then 

(1 + x) n > 1 + nx for - 1 < x < 0 and 0 < x. 

(notice that equality holds for x = 0). 



**42 
**43. 
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46. 




M 



FIGURE 27 



*47. 



Let/0) = x* sin 2 l/x for x 9* 0, and let /(0) = 0 (Figure 27). 

(a) Prove that 0 is a local minimum point for /. 

(b) Prove that /'(0) = /"(0) = 0. 

This function thus provides another example to show that Theorem 6 
cannot be improved. It also illustrates a subtlety about maxima and 
minima that often goes unnoticed: a function may not be increasing in 
any interval to the right of a local minimum point, nor decreasing in any 
interval to the left. 

(a) Prove that if f(a) > 0 and /' is continuous at a, then / is increasing 
in some interval containing a. 

The next two parts of this problem show that continuity of/' is essential. 

(b) If g(x) = x 2 sin 1 /*, show that there are numbers x arbitrarily close 
to 0 with g'(x) = 1 and also with g'(x) = — 1. 

(c) Suppose 0 < a < 1. Let /(*) = ax + x 2 sin l/x for x 9* 0, and let 
/(0) = 0 (see Figure 28). Show that / is not increasing in any open 
interval containing 0, by showing that in any interval there are 
points x with /'(*) > 0 and also points x with /'(at) < 0. 

The behavior of /for a > 1, which is much more difficult to analyze, is 
discussed in the next problem. 



*48. 




FIGURE 28 



Let f(x) = ax + x 2 sin l/x for x * 0, and let/(0) = 0. In order to find 
the sign of /'(*) when a > 1 it is necessary to decide if 2x sin l/x - cos 
1 /x is < - 1 for any numbers x close to 0. It is a little more convenient 
to consider the function g(y) = 2(sin y)/y - cos y for y * 0; we want to 
know if ^00 < -1 for large y. This question is quite delicate; the most 
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significant part of g(y) is - cos y, which does reach the value -1, but 
this happens only when sin y = 0, and it is not at all clear whether g 
itself can have values < — 1 . The obvious approach to this problem is to 
find the local minimum values of g. Unfortunately, it is impossible to 
solve the equation g'(j) = 0 explicitly, so more ingenuity is required. 

(a) Show that if g f {y) = 0, then 

cos y = sin y ^ — ~2~/ 
and conclude that 



g(y) = s'my (— 



2y 

(b) Now show that if g\y) = 0, then 



sin 2 y = 



Ay 2 



4 + y* 
and conclude that 

2 +> 2 



1*001 = 



Va + y 4 

(c) Using the fact that (2 + y 2 )/VA + / > 1, show that if a = 1, then 
/ is not increasing in any interval around 0. 

(d) Using the fact that lim (2 + y 2 )/V~A + >/ 4 = 1, show that if a > 1, 

then / is increasing in some interval around 0. 
A function / is increasing at a if there is some number 5 > 0 such that 
fix) > f(a) if a < x < a + 5 

and 

fix) < fid) if a - 8 < x < a. 

Notice that this does not mean that / is increasing in the interval (a — 8, 
a + 8); for example, the function shown in Figure 28 is increasing at 0, 
but is not an increasing function in any open interval containing 0. 

(a) Suppose that /is continuous on [0, 1] and that /is increasing at a for 
every a in [0, 1]. Prove that /is increasing on [0, 1]. (First convince 
yourself that there is something to be proved.) Hint: For 0 < b < 1, 
prove that the minimum of / on [b, 1] must be at b. 

(b) Prove part (a) without the assumption that / is continuous, by con- 
sidering for each b in [0, 1] the set S h = {x: fiy) > fib) for ally in 
[b, x] } . (This part of the problem is not necessary for the other parts.) 
Hint: Prove that S b = {x: b < x < 1 } by considering sup S b . 

(c) If/ is increasing at a and /is differentiable at a, prove that f'ia) > 0 
(this is easy). 
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(d) If f(a) > 0, prove that /is increasing at a (go right back to the defi- 
nition of f(a)). 

(e) Use parts (a) and (d) to show, without using the Mean Value 
Theorem, that if / is continuous on [0, 1] and f'(a) > 0 for all a in 

[0, 1], then / is increasing on [0, 1], 

(f) Suppose that /is continuous on [0, l]and/'(a) = 0 for all a in (0, 1). 
Apply part (e) to the function g(x) = f(x) + ex to show that 
/(l) -/(0) > -e. Similarly, show that /(l) - /(0) < £ by con- 
sidering h(x) = ex - /(*). Conclude that/(0) = /(l). 

This particular proof that a function with zero derivative must be con- 
stant has many points in common with a proof of H. A. Schwartz, which 
may be the first rigorous proof ever given. Its discoverer, at least, seemed 
to think it was. See his exuberant letter in reference [41] of the Suggested 
Reading. 

**50. If / is a constant function, then every point is a local maximum point 
for/. It is quite possible for this to happen even if / is not a constant func- 
tion: for example, if f(x) = 0 for x < 0 and /(*) = 1 for x > 0. Prove, 
however, that if / is continuous on [a, b] and every point of [a, b] is a 
local maximum point, then / is a constant function. Hint: If the mini- 
mum of / occurs at x 0 , consider the set {x in [#<>, b]\ f(y) — f(x 0 ) for all 
yin[x Q ,x]\. 

**51. (a) A point x is called a strict maximum point for / on A if 



f(x) > f(y) for all y in A with y ^ x (compare with the definition of 
an ordinary maximum point). A local strict maximum point is 
defined in the obvious way. Find all local strict maximum points of 
the function 



It seems quite unlikely that a function can have a local strict maxi- 
mum at every point (although the above example might give one 
pause for thought). Prove this as follows. 

.(b) Suppose that every point is a local strict maximum point for /. Let 
x\ be any number and choose a\ < Xi < bi with b\ — ai < 1 such 
that f(xi) > f{x) for all x in [a h b{\. Let x 2 5* *i be any point in 
(a i, bi) and choose a x < a 2 < x 2 < b 2 < bi with b 2 — a 2 < \ such 
that f(x 2 ) > f{x) for all x in [a 2 , b 2 \ Continue in this way, and 
use the Nested Interval Theorem (Problem 8-14) to obtain a 
contradiction. 




0, x irrational 
~j x — - in lowest terms. 
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APPENDIX. CONVEXITY AND CONCAVITY 

Although the graph of a function can be sketched quite accurately on the 
basis of the information provided by the derivative, some subtle aspects of the 
graph are revealed only by examining the second derivative. These details 
were purposely omitted previously because graph sketching is complicated 
enough without worrying about them, and the additional information ob- 
tained is often not worth the effort. Also, correct proofs of the relevant facts 
are sufficiently difficult to be placed in an appendix. Despite these discour- 
aging remarks, the information presented here is well worth assimilating, 
because the notions of convexity and concavity are far more important than 
as mere aids to graph sketching. Moreover, the proofs have a pleasantly 
geometric flavor not often found in calculus theorems. Indeed, the basic 
definition is geometric in nature (see Figure 1). 



DEFINITION 1 



A function / is convex on an interval, if for all a and b in the interval, the 
line segment joining (a> f(a)) and (b, f{b)) lies above the graph of /. 




The geometric condition appearing in this definition can be expressed in an 
analytic way that is sometimes more useful in proofs. The straight line between 
(a, f(a)) and (b, f(b)) is the graph of the function g defined by 

g(x) = m^m {x - a)+ /w . 

b — a 

This line lies above the graph of / at x if g(x) > f(x), that is, if 



b — a 

fib) - fja) 
b - a 



(x - a) +f(a)>f(x) 
(x-a)> f(x) - f(a) 



fib) -fja) > fix) -fja) _ 
b — a x — a 

We therefore have an equivalent definition of convexity. 



DEFINITION 2 



A function / is convex on an interval if for a, x, and b in the interval with 
a < x < b we have 

fix) - fja) < fjb ) - fja) . 



If the word "over" in Definition 1 is replaced by "under" or, equivalently, 
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(*, /(*)) 




if the inequality in Definition 2 is replaced by 



/(*) -/(«) > /W "/(*) 



b — a 



FIGURE 2 



we obtain the definition of a concave function (Figure 2). It is not hard to see 
that the concave functions are precisely the ones of the form — /, where / is 
convex. For this reason, the next three theorems about convex functions have 
immediate corollaries about concave functions, so simple that we will not even 
bother to state them. 

Figure 3 shows some tangent lines of a convex function. Two things seem to 
be true: 

(1) The graph of / lies above the tangent line at (a, f(a)) except at the 
point (a, f(a)) itself (this point is called the point of contact of the 
tangent line). 

(2) If a < b, then the slope of the tangent line at (a, f(a)) is less than the 
slope of the tangent line at (b, f{b))\ that is, /' is increasing. 

As a matter of fact these observations are true, and the proofs are not difficult. 




FIGURE 3 



THEOREM l Let / be convex. If / is differentiable at a, then the graph of / lies above the 
tangent line through (a, /(a)), except at (a, f(a)) itself. If a < b and /is differ- 
entiable at a and b, then f(a) < f'(b). 



PROOF If 0 < hi < A 2 , then, as Figure 4 indicates, 

(1) fja + hQ -f(a) < f(a + h 2 ) - f(a) 
hi hi 

A nonpictorial proof can be derived immediately from Definition 2 applied to 
a < a + hi < a + h 2 . Inequality (1) shows that the values of 

/(* + *) -/(*) 
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1 1 1 

a a + hi a -f h 2 

FIGURE 4 

decrease as h — > 0 + . Consequently, 

/(„)<MiHW forA>0 

h 

(in fact/'(tf) is the greatest lower bound of all these numbers). But this means 
that for h > 0 the secant line through (a, f(a)) and (a + h, f(a + h)) has 
larger slope than the tangent line, which implies that {a + f(a + h)) lies 
above the tangent line (an analytic translation of this argument is easily 
supplied). 

For negative h there is a similar situation (Figure 5): if h 2 < hi < 0, then 

f(a + h,) -f(a) > f(a + h 2 ) - f(a) 
hi hi 

This shows that the slope of the tangent line is greater than 

f(° + »-M {orh<0 

h 

(in fact f(a) is the least upper bound of all these numbers), so that f(a + h) 
lies above the tangent line if h < 0. This proves the first part of the theorem. 









1 


1 \ 

a + h 2 a + hi 


a 



FIGURE 5 
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FIGURE 6 



Now suppose that a < b. Then, as we have already seen (Figure 6), 

ff( v . f(a+(b-a)) -f(a) 

/ {a) < -■ since b — a > 0 

b — a 

_ fW -f(a\ 
b - a 

and 

y W -»))-/(») sincefl -, <0 

= /(g) -/(*) = /(*) - /(a) 
a — b b a 

Combining these inequalities, we obtain < /'(£). I 

figure 7 Theorem 1 has two converses. Here the proofs will be a little more difficult. 

We begin with a lemma that plays the same role in the next theorem that 
Rolle's Theorem plays in the proof of the Mean Value Theorem. It states that 
if /' is increasing, then the graph of / lies below any secant line which happens to 
be horizontal. 

LEMMA Suppose / is differentiable and /' is increasing. If a < b and f(a) = f(b), then 
/(*) < /(«) = /(*) for a < x < b. 

PROOF Suppose first that f(x) > f(a) = f(b) for some x in (a, b). Then the maximum 
of / on [a, b] occurs at some point x 0 in (a, b) with f(x 0 ) > f(a) and, of course, 
f(x 0 ) = 0 (Figure 7). On the other hand, applying the Mean Value Theorem 
to the interval [a, x 0 ], we find that there is x\ with a < x\ < #o and 

f{xi) = /(*)-/(«) > 0) 

Xo — a 
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contradicting the fact that /' is increasing. This proves that f(x) < f(a) — f(b) 
for a < x < b, and it only remains to prove that f(x) = f(a) is also impossible 
for x in (a, b). 

Suppose f(x) = f(a) for some x in (a, b). We know that / is not constant on 
[a, x] (if it were, /' would not be increasing on [a, x]) so there is (Figure 8) 
some #1 with a < x\ < x and/(*i) < f(a). Applying the Mean Value Theorem 
to [xi, x] we conclude that there is x 2 with x\ < x 2 < x and 



/'(*2) 



/to - /to) 

X — X\ 



> 0. 



On the other hand, f(x) = 0, since a local maximum occurs at x. Again this 
contradicts the hypothesis that /' is increasing. | 

We now attack the general case by the same sort of algebraic machinations 
that we used in the proof of the Mean Value Theorem. 

THEOREM 2 If / is differentiable and /' is increasing, then / is convex. 



PROOF 



Let a < b. Define g by 

g(x) = /(*) 



fib) - f(a) 
b — a 



(x - a). 



It is easy to see that g' is also increasing; moreover, g(a) = g(b) = f(a). Apply- 
ing the lemma to g we conclude that 

g(x) < f{a) if a < x < b. 

In other words, if a < x < b, then 



/to - 



Kb) - f(a) 



or 



b — a 

/(*) "/« . 



(x-a)< f(a) 
Kb) - f(a) 



THEOREM 3 



PROOF 



Hence / is convex. | 

If / is differentiable and the graph of / lies above each tangent line except at 
the point of contact, then / is convex. 

Let a < b. It is clear from Figure 9 that if (b, f(b)) lies above the tangent line 
at (a, /(a)), and (a, f(a)) lies above the tangent line at (b, fib)), then the slope 
of the tangent line at (£, fib)) must be larger than the slope of the tangent line 
at (a,f(a)). The following argument just says this with equations. 
Since the tangent line at (a, f(a)) is the graph of the function 



g(x) =f(a)(x-a)+f(a), 



and since (b, f(b)) lies above the tangent line, we have 

(1) f(b)> f{a){b - a) +f(a). 
Similarly, since the tangent line at (b, f(b)) is the graph of 

h(x) =f'(b)(x - b) +f(b), 
and (a, f(a)) lies above the tangent line at (b, f(b)), we have 

(2) f( a )>f'(bKa-b)+f(b). 

It follows from (1) and (2) that f'(a) < f'(b). 

It now follows from Theorem 2 that / is convex. | 

If a function / has a reasonable second derivative, the information given in 
these theorems can be used to discover the regions in which / is convex or 
concave. Consider, for example, the function 



For this function, 



/(*) = 



/'(*) = 



1 



1 + x 2 
-2x 



(1 + x 2 ) 2 

Thus /'(*) = 0 only for x = 0, and /(0) = 1, while 

/'(*) > 0 if x < 0, 
/'(*) < 0 if x > 0. 

/(*) > 0 for all x, 
f(x) — > 0 as # — > co or - <x> , 
/ is even. 



Moreover, 



FIGURE 10 



The graph of / therefore looks something like Figure 10. We now compute 

(1 + x 2 ) 2 {-2) + 2x • [2(1 + x 2 ) ; 2* 1 
(1 + x 2 Y 

2{2>x 2 - 1) 

(i +x 2 y' 



rod = 
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It is not hard to determine the sign of /"(*). Note first that /"(*) = 0 only 
when x = Vl/3 or - Vl/3. Since /" is clearly continuous, it must keep the 
same sign on each of the sets 

(-«,_! ^T/3), 
(- Vl/3, Vl/3), 
(Vl/3, oo). 

Since we easily compute, for example, that 

/"(-I) = *>o, 
/"(0) = -2 < 0, 
/"(I) = i > o, 

we conclude that 

/" > 0 on (- oo 5 _-^VT/3^and (VlA oo), 
/" < Oon (- Vl/3, Vl/3). 

Since /" > 0 means / is increasing, it follows from Theorem 2 that/ is convex 
on (_ 00) _ VT73) and (VT73, <»), while on (- V 1/3, V 1/3) / is con- 
cave (Figure 11). 




/ is convex / is concave 



/ is convex 



- Vl/3 



Vl/3 



FIGURE 11 



Notice that at (V 1 /3, f ) the tangent line lies below the part of the graph 
to the right, since /is convex on (Vl/3, oo), and above the part of the graph 
to the left, since / is concave on (-Vl/3, Vl/3); thus the tangent line 
crosses the graph. In general, a number a is called an inflection point of / if 
the tangent line to the graph of /at (a, f(a)) crosses the graph; thus Vl/3 and 
- Vl73 are inflection points of f(x) = 1/(1 + * 2 ). Note that the condition 
f"(a) = 0 does not ensure that a is an inflection point of /; for example, if 
/(*) = x\ then /"(0) = 0, but / is convex, so the tangent line at (0, 0) cer- 
tainly doesn't cross the graph of /. In order for a to be an inflection point of a 
function /, it is necessary that /" should have different signs to the left and 
right of a. 

This example illustrates the procedure which may be used to analyze any 
function/. After the graph has been sketched, using the information provided 



\ 
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by /', the zeros of /" are computed and the sign of /" is determined on the 
intervals between consecutive zeros. On intervals where /" > 0 the function is 
convex; on intervals where /" < 0 the function is concave. Knowledge of the 
regions of convexity and concavity of / can often prevent absurd misinter- 
pretation of other data about /. Several functions, which can be analyzed in 
this way, are given in the problems, which also contain some theoretical 
questions. 

There is one further fact which I cannot resist mentioning here. We have 
seen that convex and concave functions have the property that every tangent 
line intersects the graph just once, and a few drawings will probably convince 
you that no other functions have this property. This is indeed the case, but the 
only proof I know contains so many delicate points that I feel it is wiser to 
omit it. 

PROBLEMS 

1. Sketch, indicating regions of convexity and concavity and points of 
inflection, the functions in Problem 11-1 (consider (iv) as double 
starred) . 

2. Figure 25 in Chapter 11 shows the graph of /'. Sketch the graph of/. 

3. Find two convex functions / and g such that f(x) = g(x) if and only if x is 
an integer. 

4. Show that / is convex on an interval if and only if for all x and y in the 
interval we have 

f(tx + (1 - t)y) < tf(x) + (1 - t)f(y), for 0 < t < 1. 

(This is just a restatement of the definition, but a useful one.) 

5. Prove that if / and g are convex and / is increasing, then g o f is convex. 
*6. Let / be a twice-differentiable function with the following properties: 

f(x) > 0 for x > 0, and / is decreasing, and /'(0) = 0. Prove that 
/"(#) = 0 for some x > 0 (so that in reasonable cases / will have an 
inflection point at an example is given by f(x) = 1/(1 + x 2 )). Every 
hypothesis in this theorem is essential, as shown byf(x) = 1 — * 2 , which 
is not positive for all x; by f(x) = x 2 , which is not decreasing; and by 
f(x) = l/(x + 1), which does not satisfy /'(0) = 0. Hint: Choose x 0 > 0 
with/'(*o) < 0. We cannot have f'(y) < f(x 0 ) for all y > * 0 . Why not? 
So f(xi) > f'(xo) for some xi > * 0 . Consider /' on [0, Xi]. 
*7. (a) Prove that if / is convex, then f([x + y]/2) < [/(*) + f(y)]/2. 

(b) Suppose that /satisfies this condition. Show that f(kx + (1 — k)y) < 
kf(x) + (1 — k)f(y) whenever k is a rational number, between 0 and 
1, of the form m/2 n . Hint: Part (a) is the special case n = 1. Use 
induction, employing part (a) at each step. 

(c) Suppose that / satisfies the condition in part (a) and / is continuous. 
Show that / is convex. 
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*8. Let pi, . . . , p n be positive numbers with ^ pi = 1. 

i = i 

n 

(a) For any numbers xi, . . . , x n show that ^ piXi lies between the 

i = i 

smallest and the largest 

n-1 n-1 

(b) Show the same for (1/t) ^ piXi, where t = ^ 

t=i i=i 

n n 

(c) Prove Jensen's inequality: If/ is convex, then/ ^ A**) < ^ pif(xi). 

i=i i=i 

Hint: Use Problem 4, noting that p n — 1 — t. (Part (b) is needed to 

n - 1 

show that (1/0 ^ is in the domain of / if x u . . . , * n are.) 

t = i 

*9. (a) For any function /, the right-hand derivative, lim [f(a + h) — 

f(a)]/h, is denoted by /+'(«), and the left-hand derivative is denoted 
by /_'(#). The proof of Theorem 1 actually shows that /+' and /_' 
always exist if / is convex. Check this assertion, and also show that 
/+' and /_' are increasing, and that f-'(a) < f+(a), 
**(b) Show that if / is convex, then f+{a) = fJ{a) if and only if /+' is con- 
tinuous at a. (Thus / is differentiate precisely when /+' is con- 
tinuous.) Hint: [f(b) — f(a)]/(b — a) is close to /_'(«) for b < a 
close to <z, and /+'(£) is less than this quotient. 
**10. Prove that a convex function must be continuous. 
**11. Prove that if / is convex on R, then either / is decreasing, or else / is 
increasing, or else there is a number c such that / is decreasing on 
(-oo ; t] and increasing on [c, oo ). This problem requires a lot of careful 
bookkeeping, and is perhaps best postponed until after the next chapter, 
where a similar theorem is proved in detail. An important step for this 
problem is to establish that if f(a) < f(b) for some a < b, then / is 
increasing on [b, cc), while / is decreasing on (— oo, a ] if f(a) > f(b). 
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CHAPTER I INVERSE FUNCTIONS 



We now have at our disposal quite powerful methods for investigating func- 
tions; what we lack is an adequate supply of functions to which these methods 
may be applied. We have studied various ways of forming new functions from 
old — addition, multiplication, division, and composition — but using these 
alone, we can produce only the rational functions (even the sine function, 
although frequently used for examples, has never been defined). In the next 
few chapters we will begin to construct new functions in quite sophisticated 
ways, but there is one important method which will practically double the 
usefulness of any other method we discover. 

If we recall that a function is a collection of pairs of numbers, we might hit 
upon the bright idea of simply reversing all the pairs. Thus from the function 



we obtain 



/= {(1,2), (3, 4), (5, 9), (13, 8)}, 
g = {(2,1), (4, 3), (9, 5), (8,13)}. 



While /(l) - 2 and /(3) - 4, we have ^(2) = 1 and g(4) = 3. 
Unfortunately, this bright idea does not always work. If 



then the collection 



/= {(1,2), (3, 4), (5, 9), (13, 4)}, 
{(2, 1), (4, 3), (9, 5), (4,13)} 



is not a function at all, since it contains both (4, 3) and (4, 13). It is clear 
where the trouble lies: /(3) = /(13), even though 3 ^ 13. This is the only 
sort of thing that can go wrong, and it is worthwhile giving a name to the 
functions for which this does not happen. 



DEFINITION 



A function / is one-one (read "one-to-one") if f(a) ^ f(b) whenever a ^ b. 



The identity function / is obviously one-one, and so is the following modifi- 
cation: 

Ix, x 3, 5 
3, x = 5 
5, x = 3. 

The function f(x) = x 2 is not one-one, since /( — 1) = /(l), but if we define 

g{x) = x\ x > 0 

(and leave g undefined for x < 0) , then g is one-one, because g is increasing 
200 
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(since g'(x) = 2x > 0, for x > 0). This observation is easily generalized: If n 
is a natural number and 

/(*) - x n , x > 0, 

then / is one-one. If n is odd, one can do better: the function 

f{x) = x n for all x 

is one-one (since /'(*) = nx n ~ l > 0, for all x ^ 0). 

It is particularly easy to decide from the graph of /whether /is one-one: the 
condition f{a) ^ fib) for a ^ b means that no horizontal line intersects the 
graph of / twice (Figure 1). 





a one one function 

(a) 

FIGURE 1 



a function which is not one one 

(b) 



If we reverse all the pairs in (a not necessarily one-one function) / we obtain, 
in any case, some collection of pairs. It is popular to abstain from this pro- 
cedure unless / is one-one, but there is no particular reason to do so — instead 
of a definition with restrictive conditions we obtain a definition and a theorem. 



DEFINITION 



For any function /, the inverse of/, denoted by/- 1 , is the set of all pairs 
(a, b) for which the pair (b, a) is in /. 



THEOREM l / 1 is a function if and only if / is one-one. 

PROOF Suppose first that / is one-one. Let (a, b) and (a, c) be two pairs in f~\ Then 
(b, a) and (c, a) are in /, so a = fib) and a = f(c); since / is one-one this 
implies that b = c. Thus f~ l is a function. 

Conversely, suppose that/ -1 is a function. If fib) = /(c), then / contains the 
pairs ib,fib)) and (*,/(*)) = ic, fib)), so (/(*), b) and (/(*),<;) are in / l . 
Since / _1 is a function this implies that b = c. Thus / is one-one. | 

The graphs off and / _1 are so closely related that it is possible to use the 
graph of / to visualize the graph of / _1 . Since the graph of / _1 consists of all 
pairs (a, b) with (b, a) in the graph of /, one obtains the graph off' 1 from the 
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graph of / by interchanging the horizontal and vertical axis. If/ has the graph 
shown in Figure 2(a), 




FIGURE 2(a) 
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FIGURE 4 




This procedure is awkward with books and impossible with blackboards, 
so it is fortunate that there is another way of constructing the graph of/ -1 . The 
points (a, b) and (b, a) are reflections of each other through the graph of 
I(x) = x, which is called the diagonal (Figure 4). To obtain the graph of/ -1 
we merely reflect the graph of / through this line (Figure 5). 

Reflecting through the diagonal twice will clearly leave us right back where 
we started; this means that (/ _1 ) _1 = /, which is also clear from the definition. 
In conjunction with Theorem 1, this equation has a significant consequence: 
if / is a one-one function, then the function / _1 is also one-one (since {f~~ l )~ l is 
a function). 

There are a few other simple manipulations with inverse functions of which 
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FIGURE 5 




FIGURE 6 




FIGURE 7 



LEMMA 1 



PROOF 



you should be aware. Since {a, b) is in / precisely when (b, a) is in / \ it 
follows that 

b = f(a) means the same as a ~ 

Thus j~\b) is the (unique) number a such that f(a) = b; for example, if 
f(x) = x 3 , then/" 1 ^) is the unique number a such that a 3 = b, and this num- 
ber is, by definition, \fb. 

The fact that f 1 (x) is the number y such that f(y) = x can be restated in a 
much more compact form: 

/(/ _1 W) = *> for a11 * in the domain of 

Moreover, 

Z" 1 (/(*)) = ^ f° r a ^ * ^ n tlie domain of /; 
this follows from the previous equation upon replacing / by f~\ These two 
important equations can be written 

r i o/ = / 

(except that the right side will have a bigger domain if the domain of /or/ -1 is 
not all of R). 

Since many standard functions will be defined as the inverses of other func- 
tions, it is quite important that we be able to tell which functions are one-one. 
We have already hinted which class of functions are most easily dealt with— 
increasing and decreasing functions are obviously one-one. Moreover, if/ is 
increasing, then/ -1 is also increasing, and if/ is decreasing, then/ -1 is decreas- 
ing (the proof is left to you). In addition, / is increasing if and only if — / is 
decreasing, a very useful fact to remember. 

It is certainly not true that every one-one function is either increasing or 
decreasing. One example has already been mentioned, and is now graphed in 
Figure 6: 

I, X 3, 5 

3, x = 5 
5, x = 3. 

Figure 7 shows that there are even continuous one-one functions which are 
neither increasing nor decreasing. But if you try drawing a few pictures you 
will soon agree that every one-one continuous function defined on an interval 
is either increasing or decreasing. This theorem is a bureaucrat's delight; the 
proof uses no new ideas, but it does require careful organization. It helps to 
begin with two lemmas, the second being a corollary of the first. 

Let / be a continuous one-one function defined on an interval, and let a, b, 
and c be points of the interval with a < c < b. If f(a) < f(b), then f(a) < 
f(c) < f(b); and if }{a) > f(b), then f{a) > f(c) > f(b) (as in Figure 8). 

Consider first the case where f(a) < f(b). Since c ^ a, b we have /(c) ^ /(*), 



204 Derivatives and Integrals 



^ h 



H h 



FIGURE 9 



FIGURE 10 



(a) 

FIGURE 8 



and f(c) 7*f(b), so 



(b) 



either f(c) < f(a) 

or f( a ) <f(c) <f(b) 
or f{b) <f(c), 

and it is only necessary to rule out the first and third possibilities. 

Suppose that f(c) < f(a) were true (Figure 9). Apply the Intermediate 
Value Theorem to the interval [c, b]\ since f(c) < f(a) < f(b) there is some x 
in [c, b] such that f(x) = f(a). But this contradicts the fact that / is one-one, 
since a ^ x. Thus f(c) < f{a) is impossible. 

Similarly, suppose that f{c) > f(b) were true (Figure 10). Apply the Inter- 
mediate Value Theorem to the interval [a, c] : since f(a) < f(b) < f(c) there is 
some x in [a, c] such that f(x) = f(b), again contradicting the fact that / is 
one-one. Thus f(c) > f(b) is also false, leaving only the possibilitv f(a) < 
f(b) <f{c). 

The case where f(a) > f(b) may be handled in precisely the same way. Or 
one can be elegant and apply the first case to — /. | 



LEMMA 2 Let / be a continuous one-one function defined on an interval, let a and b be 
two points of the interval, and suppose that f(a) < f(b). If c is a point of the 
interval with c < a, then f(c) < f(a); and similarly, if b < c, then f(b) < f(c). 
(Analogous statements could be made if f(a) > f(b), but we will not need 
them.) 

PROOF Consider the case c < a. Suppose first that f(c) > f(b). Then Lemma 1, 
applied to c < a < b, would imply that f{a) > f(b), which is false. Hence 
fif) < fQ>). But now Lemma 1 may be applied to c < a < b to conclude that 
f(c) <f{a)<f{b). 

The case b < c is handled similarly. | 



Finally, we are ready for the theorem. 



theorem 2 If / is continuous and one-one on an interval, then / is either increasing or 
decreasing on that interval. 



PROOF 



Let a and b be two numbers in the interval with a < b. Since f(a) ^ /(£), 
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either f(a) < f(b) or f(a) > fib). We will first concentrate on the case f(a) < 
fib), and show that / is increasing. 

Let c and d be two points in the interval with c < d. If one (or both) of c, d 
equals a or b, then it follows immediately from Lemmas 1 and 2 that /(c) < 
f{d). The other possibility leads to six cases: 



— 1 — \ 

c 


1 

a 


1 

d b 
— 1 — 1 


— 1 — 

c 


1 

a 


— \ 1 


— 1 — 


1 

a c 
1 I— 


d b 
— 1 — 1 




a c 


b d 


1 1 1 1 

a bed 
1 ! 1 1- 



(1) c < d < a < b 

(2) c < a < d < b 

(3) c < a < b < d 

(4) a <c <d < b 

(5) a < c < b < d 

(6) a < b < c < d 

Each of these cases can be treated easily, using the lemmas. For example, in 
case (1) first apply Lemma 2 to c < a < b to conclude that /(c) < f(a), and 
then apply Lemma 1 to c < d < a to conclude that f(c) < }{d). The other 
cases are left to you, as an easy exercise. 

If /(a) > f{b), one can prove similarly that /is decreasing. Or one can apply 
the result just proved to -/ (clearly the preferable method). | 

Henceforth we shall be concerned almost exclusively with continuous 
increasing or decreasing functions which are defined on an interval. If/ is such 
a function, it is possible to say quite precisely what the domain of/ 1 will be 
like. 

Suppose first that /is a continuous increasing function on the closed interval 
[a, b\ Then, by the Intermediate Value Theorem, / takes on every value 
between f{a) and fib). Therefore, the domain of/" 1 is the closed interval 
[f(a),f(b)l Similarly, if / is continuous and decreasing on [a, b\ then the 
domain of f' 1 is [f(b)J(a)\ 

If / is a continuous increasing function on an open interval (a, b) the analysis 
becomes a bit more difficult. To begin with, let us choose some point c in 
(a, b). We will first decide which values >f(c) are taken on by / One possi- 
bility is that / takes on arbitrarily large values (Figure 1 1). In this case / takes 
on all values >f(c) , by the Intermediate Value Theorem. If, on the other hand, 
/ does not take on arbitrarily large values, then A = {/(*): c < x < b} is 
bounded above, so A has a least upper bound a (Figure 12). Now suppose y is 
any number with /(c) < y < a. Then / takes on some value /(*) > y (because 
a is the least upper bound of A). By the Intermediate Value Theorem, / 
actually takes on the value y. Notice that / cannot take on the value a itself; 
for if a = /(*) for a < x < b and we choose t with x < t < b, then /(/) > a, 
which is impossible. 
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THEOREM 3 

PROOF 




a — £ a a + s 

FIGURE 13 



Precisely the same arguments work for values less than f(c) : either / takes 
on all values less than f(c) or there is a number ($ < f(c) such that / takes on all 
values between /3 and f(c), but not fi itself. 

This entire argument can be repeated if / is decreasing, and if the domain 
off is R or (a, <x>) or (— oo, a). Summarizing: if / is a continuous increasing, 
or decreasing, function whose domain is an interval having one of the forms 

{a, b), (-oc, b), {a, oo), or R, 

then the domain of f' 1 is also an interval which has one of these four forms. 

Now that we have completed this preliminary analysis of continuous one- 
one functions, it is possible to begin asking which important properties of a 
one-one function are inherited by its inverse. For continuity there is no 
problem. 

If/ is continuous and one-one on an interval, then/ -1 is also continuous. 

We know by Theorem 2 that / is either increasing or decreasing. We might as 
well assume that / is increasing, since we can then take care of the other case 
by applying the usual trick of considering — /. 
We must show that 

lim /-*(*) =/-'(*) 

for each b in the domain of/" 1 . Such a number b is of the form /(a) for some a 
in the domain of/. For any s > 0, we want to find a 5 > 0 such that, for all x, 

if f(a) - 8 < x < f{a) + 8, then a - £ < f~ l (x) < a + e. 

Figure 13 suggests the way of finding 8 (remember that by looking sideways 
you see the graph of f~ l ): since 

a — e < a < a + Z, 

it follows that 

/(*-e) </(*) </(* + £); 

we let 8 be the smaller of f(a + e) - f(a) and f(a) - f(a - e). Figure 13 con- 
tains the entire proof that this 8 works, and what follows is simply a verbal 
account of the information contained in this picture. 
Our choice of 8 ensures that 

fifl - e) < f(a) - 8 and f(a) + 8 < f(a + e). 
Consequently, if 

/(a) - 5 < * < f{a) + 5, 

then 

f(a - e) < at </( fl + e). 
Since / is increasing, /~ x is also increasing, and we obtain 



r i U(a - £)) </-*(*) </" 1 (/(« + e)), 
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/ 



/ 



, /(«)) 



THEOREM 4 



i.e., 

a - e < < a + e, 

which is precisely what we want. | 

Having successfully investigated continuity of f~\ it is only reasonable to 
tackle differentiability. Again, a picture indicates just what result ought to be 
true. Figure 14 shows the graph of a one-one function / with a tangent line L 
through (a, f(a)). If this entire picture is reflected through the diagonal, it 
shows the graph of/ -1 and the tangent line U through (f(a), a). The slope of 
V is the reciprocal of the slope of L. In other words, it appears that 



f(a) 



This formula can equally well be written in a way which expresses (/ *)'(*) 
directly, for each b in the domain of f 1 : 



(r i )'w = 



i 



Unlike the argument for continuity, this pictorial "proof becomes some- 
what involved when formulated analytically. There is another approach 
which might be tried. Since we know that 

it is tempting to prove the desired formula by applying the Chain Rule: 



(rrw - 



W) 



Unfortunately, this is not a proof that / _1 is differentiable, since the Chain 
Rule cannot be applied unless f~ l is already known to be differentiable. But 
this argument does show what (/""*) 'M wil1 have to be if f~ l is differentiable, 
and it can also be used to obtain some important preliminary information. 

If / is a continuous one-one function defined on an interval and/'Cf" 1 ^)) = 0, 
then f 1 is not differentiable at a. 



PROOF We have 

If/"" 1 aw* differentiable at a, the Chain Rule would imply that 



hence 

which is absurd. | 
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THEOREM 5 



] f{x) = x* 




(b) 



FIGURE 15 



A simple example to which Theorem 4 applies is the function f(x) = # 3 . 
Since /'(0) = 0 and 0 = f~\0), the function f~ l is not differentiable at 0 
(Figure 15). 

Having decided where an inverse function cannot be differentiable, we are 
now ready for the rigorous proof that in all other cases the derivative is given 
by the formula which we have already "derived" in two different ways. 
Notice that the following argument uses continuity of which we have 
already proved. 

Let / be a continuous one-one function defined on an interval, and suppose 
that / is differentiable at f"\b), with derivative f(f~~ l (b)) ^ 0. Then f~ l is 
differentiable at b, and 



i 



f(r\b)) 



PROOF Let b = f(a). Then 



lim 



r\b + h) - r\b) 



= lim 



f~\b + h) - a 



Now every number b + h in the domain of / 1 can be written in the form 

b + h - f(a + k) 

for a unique k (we should really write k(h), but we will stick with k for sim- 
plicity). Then 



lim 

h->Q 



}-\b +h)-a 



= lim 



f'Kfia + k)) - a 



a-*o f(a + k) — b 

= lim 

;.-.o f(a + k) - f{a) 

We are clearly on the right track ! It is not hard to get an explicit expression 
for k; since 



b + h = f(a + k) 
f~\b + h) =a + k 

k=n(b+h) -/-'(*). 

Now by Theorem 3, the function / _1 is continuous at b. This means that k 



we have 



or 
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approaches 0 as h approaches 0. Since 



lim f(a + k)-f(a) = fl{a) = f{nm ^ 0> 

k->0 K 



this implies that 



The work we have done on inverse functions will be amply repaid later, but 
here is an immediate dividend. For n odd, let 

/„(#) = x n for all x; 

for n even, let 

f n (x) =x n , x> 0. 
Then f n is a continuous one-one function, whose inverse function is 

gn(x) = Vx = 
By Theorem 5 we have, for x ^ 0, 

1 



/»'(/« 


"'to) 




1 


n{fn~~ 




1 





- I 1 

1 

Thus, if /(a:) = x a , and a is an integer or the reciprocal of a natural number, 
then/'(*) = It is now easy to check that this formula is true if a is any 

rational number: Let a = m/n, where m is an integer, and n is a natural num- 
ber; if 

f( x ) = x m ' n = (j 1 '*)", 

then, by the Chain Rule, 

f(x) = mix 1 '")™- 1 • i • j™**- 1 

_ ^ . x [(m/n)-(l/n)l + ((l/n)-ll 
= ™ _y(m/n)-l_ 



Although we now have a formula for /'(*) when f(x) — x a and a is rational, 
the treatment of the function f(x) ~ x a for irrational a will have to be 
saved for later — at the moment we do not even know the meaning of a symbol 
like x^ 2 . Actually, inverse functions will be involved crucially in the definition 
of x a for irrational a. Indeed, in the next few chapters several important func- 
tions will be defined in terms of their inverse functions. 



PROBLEMS 



1 . Find / 1 for each of the following /. 

(i) f{x) - x*+ 1. 

(ii) f( X ) = (X - 1)1 

x, x rational 
—x, x irrational. 



(iii) f(x) 

(iv) f{x) 



\ - x\ x < 0. 

Ix, x 7* ai 9 . . . , a n 
x = a i9 i = 1, . . . , n - 1 
ai, x = a n . 

(vi) fix) = x + [x]. 

(vii) /(0.<zia 2 tf3 • • •) = 0.a 2 aia 3 .... (Decimal representation is be- 
ing used.) 

(viii) fix) = -— — , -1 < x < 1. 

1 — X 

2. Describe the graph of/"" 1 when 

(i) / is increasing and always positive. 

(ii) / is increasing and always negative. 

(iii) / is decreasing and always positive. 

(iv) / is decreasing and always negative. 

3. Complete the proof of Theorem 2. 

4. Prove that if / is increasing, then so is f~\ and similarly for decreasing 
functions. 

5. If / and g are increasing, is / + g ? Or / • g ? Or/og? 

6. (a) Prove that if /and g are one-one, then/o^ is also one-one. Find 

(/ 0 ^ terms of f~~ l and g -1 . Hint: The answer is not f~ l o g _1 . 

(b) Find £ -1 in terms of f~ l if g{x) = 1 +/(*)• 

7. Show that fix) = — - is one-one if and only if ad — be ^ 0, and 

ex -f- d 

find / _1 in this case. 
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8. On which intervals [a, b] will the following functions be one-one? 

(i) f{x) = x*- 3x 2 . 

(ii) f(x) = x h + x. 

(iii) f(x) = (1 + **)"'. 

(iv) /(*) = ^±L 

X 2 + 1 

9. Suppose that / is a one-one function and that Z" 1 has a derivative which 
is nowhere 0. Prove that / is differentiate. Hint: There is a one-step 
proof. 

*10. (a) Prove that there is a differentiable function / such that [f(x)] b + 
f(x) + x = 0 for all x. Hint: Show that / can be expressed as an 
inverse function. The easiest way to do this is to find And the 
easiest way to do this is to set x = f~ l iy). 

(b) Find /' in terms of /, using an appropriate theorem of this chapter. 

(c) Find /' in another way, by simply differentiating the equation 
defining /. 

The function in Problem 10 is often said to be defined implicitly by the 
equation v 5 + y + x = 0. The situation for this equation is quite special, 
however. As the next problem shows, an equation does not usually define a 
function implicitly on the whole line, and in some regions more than one func- 
tion may be defined implicitly. 

11. (a) What are the two differentiable functions / which are defined 

implicitly on ( — 1, 1) by the equation x 2 + y 2 = 1, i.e., which 
satisfy x 2 + [f(x)] 2 = 1 for all x in (-1, 1)? Notice that there are 
no solutions defined outside [— 1, 1]. 
(b) Which functions / satisfy x 2 + [fix)] 2 = -1? 

*(c) Which differentiable functions / satisfy [fix)]' 3 — 3/(#) — x? Hint: 
It will help to first draw the graph of the function g(x) = x z — 3x. 

In general, determining on what intervals a differentiable function is 
defined implicitly by a particular equation may be a delicate affair, and is 
best discussed in the context of advanced calculus. If we assume that / is such 
a differentiable solution, however, then a formula for f(x) can be derived, 
exactly as in Problem 10(c), by differentiating both sides of the equation 
defining / (a process known as "implicit differentiation") : 

12. (a) Apply this method to the equation [f(x)] 2 + x 2 = 1. Notice that 

your answer will involve fix) ; this is only to be expected, since there 
is more than one function defined implicitly by the equation 
y 2 + x 2 - 1. 
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(b) But check that your answer works for both of the functions / found 
in Problem 11(a). 

(c) Apply this same method to [/(*)] 3 — 3/(x) = x. 

13. Leibnizian notation is particularly convenient for implicit differenti- 
ation. Because y is so consistently used as an abbreviation for /(*), the 
equation in x and y which defines / implicitly will automatically stand 
for the equation which / is supposed to satisfy. How would the following 
computation be written in our notation? 

y* + y* + xy = 1, 

+ +, + 4 = 0, 

ax ax dx 

dy _ -y 



dx 4y 3 + 3y 2 + x 

14. As long as Leibnizian notation has entered the picture, the Leibnizian 
notation for derivatives of inverse functions should be mentioned. If 
dy/dx denotes the derivative of /, then the derivative of / _1 is denoted by 
dx/dy. Write out Theorem 5 in this notation. The resulting equation will 
show you another reason why Leibnizian notation has such a large 
following. It will also explain at which point {f l Y is to be calculated 
when using the dx/dy notation. What is the significance of the following 
computation? 



n— l 



x = y 
y = x 1/n , 
dx 1 !" _ dy 
dx dx dx ny 
dy 

15. Suppose that / is a differentiate one-one function with a nowhere zero 
derivative and that / = F'. Let G{x) = xf~\x) - F(f~ l (x)). Prove that 
G'{x) — (Disregarding details, this problem tells us a very inter- 
esting fact: if we know a function whose derivative is /, then we also 
know one whose derivative is f~ l . But how could anyone ever guess the 
function G? Two different ways are outlined in Problems 14-10 and 
18-13.) 

16. Suppose h is a function such that h! (x) = sin 2 (sin(# + 1)) and h(0) = 3. 
Find 

(i) (h~~ l )'(?>). 

(ii) (/?- 1 ) / (3), where (3(x) = h{x + 1). 

17. Find a formula for (/^"M. 

*18. Prove that if / (fc) (/ _1 (*)) exists, and is nonzero, then U~ l ) ik \ x ) exists. 
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19. (a) Prove that an increasing and a decreasing function intersect at most 
once. 

(b) Find two continuous increasing functions / and g such that f(x) = 
g(x) precisely when x is an integer. 

(c) Find a continuous increasing function / and a continuous decreasing 
function g, defined on R, which do not intersect at all. 

*20. (a) If / is a continuous function on R and / = f~\ prove that there is at 
least one x such that f(x) = x. (What does the condition / = f~ l 
mean geometrically?) 

(b) Give several examples of continuous / such that / = f~ 1 andf(x) = x 
for exactly one x. Hint: Try decreasing /, and remember the geo- 
metric interpretation. One possibility is f(x) = — x. 

(c) Prove that if / is an increasing function such that / = /~"\ then 
f(x) = x for all x. Hint: Although the geometric interpretation will 
be immediately convincing, the simplest proof (about 2 lines) is to 
rule out the possibilities f(x) < x and f(x) > x. 

*21. Which functions have the property that the graph is still the graph of a 
function when reflected through the graph of — / (the "antidiagonal") ? 
22. A function / is nondecreasing if f(x) < f(y) whenever x < y. (To be 
more precise we should stipulate that the domain of / be an interval.) 
A nonincreasing function is defined similarly. Caution: Some writers 
use "increasing" instead of "nondecreasing," and "strictly increasing" 
for our "increasing." 

(a) Prove that if / is nondecreasing, but not increasing, then / is constant 
on some interval. (Beware of unintentional puns: "not increasing" 
is not the same as "nonincreasing.") 

(b) Prove that if / is differentiate and nondecreasing, then f{x) > 0 
for all .v. 

(c) Prove that if /'(*) > 0 for all x, then / is nondecreasing. 

*23. (a) Suppose that f(x) > 0 for all x, and that /is decreasing. Prove that 
there is a continuous decreasing function g such that 0 < g(x) < f{x) 
for all x. 

(b) Show that we can even arrange that g will satisfy lim g(x)/f(x) = 0. 
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The derivative does not display its full strength until allied with the "integral," 
the second main concept of Part III. At first this topic may seem to be a com- 
plete digression — in this chapter derivatives do not appear even once! The 
study of integrals does require a long preparation, but once this preliminary 
work has been completed, integrals will be an invaluable tool for creating new 
functions, and the derivative will reappear in Chapter 14, more powerful than 
ever. 

Although ultimately to be denned in a quite complicated way, the integral 
formalizes a simple, intuitive concept — that of area. By now it should come 
as no surprise to learn that the definition of an intuitive concept can present 
great difficulties — "area" is certainly no exception. 

In elementary geometry, formulas are derived for the areas of many plane 
figures, but a little reflection shows that an acceptable definition of area is 
seldom given. The area of a region is sometimes defined as the number of 
squares, with sides of length 1, which fit in the region. But this definition is 
hopelessly inadequate for any but the simplest regions. For example, a circle 
of radius 1 supposedly has as area the irrational number 7r, but it is not at all 
clear what u w squares" means. Even if we consider a circle of radius 1 /vV, 
which supposedly has area 1 , it is hard to say in what way a unit square fits in 
this circle, since it does not seem possible to divide the unit square into pieces 
which can be arranged to form a circle. 

In this chapter we will only try to define the area of some very special 
regions (Figure 1) — those which are bounded by the horizontal axis, the verti- 
cal lines through (a, 0) and (6, 0), and the graph of a function /such that 
f(x) > 0 for all x in [a, b]. It is convenient to indicate this region by R(f, a, b). 
Notice that these regions include rectangles and triangles, as well as many 
other important geometric figures. 

The number which we will eventually assign as the area of R(f, a, b) will be 
called the integral off on [a, b\ Actually, the integral will be defined even for 
functions / which do not satisfy the condition f(x) > 0 for all x in [a, b). If / is 
the function graphed in Figure 2, the integral will represent the difference of 
the area of the lightly shaded region and the area of the heavily shaded 
region (the "algebraic area" of R(f, a, b)). 

The idea behind the prospective definition is indicated in Figure 3. The 
interval [a, b] has been divided into four subintervals 

by means of numbers to, h, t 2 > t 3 , t± with 

a = to < t\ < h < t s < ti = b 

214 
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FIGURE 3 



DEFINITION 



DEFINITION 



(the numbering of the subscripts begins with 0 so that the largest subscript 
will equal the number of subintervals). 

On the first interval [h, h] the function /has the minimum value mi and the 
maximum value Mi; similarly, on the ith interval ti] let the minimum 

value of / be m £ and let the maximum value be Mi. The sum 

s = m x (h - f 0 )'+ rn 2 (t2 - h) + m z (h - t%) + m 4 (*4 - h) 
represents the total area of rectangles lying inside the region #(/, a, b), while 
the sum 

S = Mi(h - to) + M 2 (t 2 ~ h) + M z (h - h) + M,(U - h) 

represents the total area of rectangles containing the region R(f, a, b). The 
guiding principle of our attempt to define the area A of R(f, a, b) is the obser- 
vation that A should satisfy 

s < A and A < S, 

and that this should be true, no matter how the interval [a, b] is subdivided. It is to 
be hoped that these requirements will determine A. The following definitions 
begin to formalize, and eliminate some of the implicit assumptions in, this 
discussion. 



Let a < b. A partition of the interval [a, b] is a finite collection of points in 
[a, b\, one of which is a, and one of which is b. 



The points in a partition can be numbered t Q , . . . 5 t n so that 

a = to < ti < • • • < f w -l < tn = b\ 

we shall always assume that such a numbering has been assigned. 



Suppose / is bounded on [a, b] and P = {* 0 , • • • , *n} is a partition of 
[a, b]. Let 

m { = inf {/(*): < x < ti}, 
Mi = sup {/(*): fe-i < x < h}. 

The lower sum of / for P, denoted by L(f, P), is defined as 

n 

Uj, P) = J rmiu - ti-i). 

The upper sum of / for P, denoted by U(f, P), is defined as 

n 

U(f, P) = J Miih - 



The lower and upper sums correspond to the sums s and S in the previous 
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FIG URE 4 




FIGURE 5 



example; they are supposed to represent the total areas of rectangles lying 
below and above the graph of /. Notice, however, that despite the geometric 
motivation, these sums have been defined precisely without any appeal to a 
concept of "area." 

Two details of the definition deserve comment. The requirement that / be 
bounded on [a, b] is essential in order that all the rrii and Mi be defined. Note, 
also, that it was necessary to define the numbers m { and Mi as inf s and sup's, 
rather than as minima and maxima, since / was not assumed continuous. 

One thing is clear about lower and upper sums: If P is any partition, then 



because 



and for each i we have 



L(f, P) < £/(/, P), 

n 

Uf, P) = J m&t - 

i = l 
n 

U(f, P)= T Mi<M - 
i = l 

mi(ti - < Mi(k - jf t _i). 



On the other hand, something less obvious ought to be true: If Pi and Ps are 
any two partitions of [a, b], then it should be the case that 

L(f, Pi) < £/(/, P 2 ), 

because L(f, Pi) should be < area P(/, a, b), and U(f, P 2 ) should be > area 
P(/> b). This remark proves nothing (since the "area of P(/, a, b)" has not 
even been defined yet), but it does indicate that if there is to be any hope of 
defining the area of P(/, <z, b), a proof that L(f, Pi) < U(f, P 2 ) should come 
first. The proof which we are about to give depends upon a lemma which 
concerns the behavior of lower and upper sums when more points are included 
in a partition. In Figure 4 the partition P contains the points in black, and Q 
contains both the points in black and the points in grey. The picture indicates 
that the rectangles drawn for the partition Q are a better approximation to the 
region R(f, a, b) than those for the original partition P. To be precise: 

lemma If Q contains P (i.e., if all points of P are also in Q), then 

L(/, P) < L(/, Q), 
£/(/, P) > U(f 9 Q). 

PROOF Consider first the special case (Figure 5) in which Q contains just one more 
point than P: 

P = {^o, • • . , t n }, 

Q = {*o> • • • , • • • , t n }, 

where 

a = t 0 < h < - • • < < m < f fc < • • • < /„ = b. 
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Let 



m! = inf {/(#): t k -i < # < u} 9 
m" = inf {/(*): w < * < fe}. 



Then 

n 

L(/, P) = £ ^ - fe-i), 
? = i 

Jb-1 n 
t=l i=k+l - 

To prove that P) < Q) it therefore suffices to show that 

m k {t k - < m'iu - t k -i) + m"(th — u). 

Now the set {/(#): < a: < t k ] contains all the numbers in {/(*): t k -i < 
x < u } , and possibly some smaller ones, so the greatest lower bound of the 
first set is less than or equal to the greatest lower bound of the second; thus 

m k < m! . 

Similarly, 

m k < m" . 

Therefore, 

m k {t k — = m k (u — t k -i) + m k {t k — u) < m'(u - t k _ x ) + m n (t k — u). 

This proves, in this special case, that L(f, P) < L(f, Q). The proof that 
U(f, P) > U(f, Q) is similar, and is left to you as an easy, but valuable, 
exercise. 

The general case can now be deduced quite easily. The partition Q can be 
obtained from P by adding one point at a time; in other words, there is a 
sequence of partitions 

P = P h P 2 , . . . , P a = Q 
such that P j+ i contains just one more point than P jt Then 

L(f, P) = L(f, Pi) < US, Pi) < • • • < US, P a ) = L(f, Q), 

and 

U(f, P) = U(f, PO > U(f, ft) > • • • > U(f, P.) = £/(/, Q). I 
The theorem we wish to prove is a simple consequence of this lemma. 

THEOREM i Let P x and P 2 be partitions of [a, b], and let / be a function which is bounded on 
[a, b]. Then 

L(f, Pi) < U(f 9 P 2 ). 

PROOF There is a partition P which contains both Pi and P 2 (let P consist of all points 
in both Pi and P 2 ). According to the lemma, 

US, Pi) < US, P) < u(f, P) < u(f, p 2 ). | 



It follows from Theorem 1 that any upper sum £/(/, P') is an upper bound 
for the set of all lower sums L(f, P). Consequently, any upper sum £/(/, P f ) is 
greater than or equal to the least upper bound of all lower sums: 

sup {£(/, ?):?a partition of [a, b]} < U(f, P'), 

for every P f . This, in turn, means that sup {L(f, P)} is a lower bound for the 
set of all upper sums of /. Consequently, 

sup {£(/,/>)} < inf {£/(/, P)}. 

It is clear that both of these numbers are between the lower sum and upper 
sum of / for all partitions: 

£(/,/*)< sup \L(f, P)} < £/(/, />'), 
L(f y P') <inf ([/(/,?)) < U(f,P'), 

for all partitions P'. 

It may well happen that 

sup{L(/,P)} = inf {£/(/, P}; 

in this case, this is the <m/y number between the lower sum and upper sum of 
/ for all partitions, and this number is consequently an ideal candidate for the 
area of R(f, a, b). On the other hand, if 

sup [L{f,P)\ < inf \U(f,P)}> 

then every number x between sup {£(/, P) } and inf {U(f, P)} will satisfy 

L{f, p')< x < u(f, n 

for all partitions P'. 

It is not at all clear just when such an embarrassment of riches will occur. 
The following two examples, although not as interesting as many which will 
soon appear, show that both phenomena are possible. 

Suppose first that f(x) = c for all x in [a, b] (Figure 6). If P = {^o, . • • , t n \ 
is any partition of [a, b\ then 

rrii — Mi = c, 

so 

n 

L(f, P) = ^ <*< ~ = < b ~ a ). 

i = l 
n 

(/(/, P) = J c(h - <,_,) = c{b - a). 

t = 1 

In this case, all lower sums and upper sums are equal, and 

sup P)} - inf {U(f, P)} = c(b - a). 

Now consider (Figure 7) the function / defined by 

v _ I 0, x irrational 
* ' ~ I 1, x rational. 
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a = t 0 h t % 



tn-l t n =b 



FIGURE 7 



DEFINITION 



and 



Therefore, 



If P = {fo, • • • > tn] is any partition, then 

rrii - 0, since there is an irrational number in [f f -_i, /»•], 

Af,= 1, since there is a rational number in 

n 

L(/, P) = ('«• - **-0 = °» 

1 = 1 

n 

£/(/, P) = J 1 ' (U - fe-i) = b - a. 
i = i 

Thus, in this case it is certainly no/ true that sup {£(/, P) } = inf { U(f, P) }. 
The principle upon which the definition of area was to be based provides 
insufficient information to determine a specific area for R(f, a, 6)— any num- 
ber between 0 and b — a seems equally good. On the other hand, the region 
R(J, a, b) is so weird that we might with justice refuse to assign it any area at 
all. In fact, we can maintain, more generally, that whenever 

sup {L(f,P)} *inf {£/(/, P)l 

the region R(f, a, b) is too unreasonable to deserve having an area. As our 
appeal to the word "unreasonable" suggests, we are about to cloak our 
ignorance in terminology. 



A function / which is bounded on [a, b] is integrable on [a, b] if 
sup { L(f, P) : P a partition of [a, b] } = inf { U(f, P) : P a partition of [a, b] } . 
In this case, this common number is called the integral of /on [a, b] and 
is denoted by 

/.'/• 

(The symbol J is called an integral sign and was originally an elongated s, for 
"sum;" the numbers a and b are called the lower and upper limits of integration.) 
The integral j* f is also called the area of R(J 9 a, b) when /(*) > 0 for all x 
in [a, b]. 



If / is integrable, then according to this definition, 

L(f, P) < J b f^ U (f> ^) for a11 Partitions P of [a, b]. 

Moreover, j b f is the unique number with this property. 

This definition merely pinpoints, and does not solve, the problem discussed 
before: we do not know which functions are integrable (nor do we know how 
to find the integral of/ on [a, b] when / is integrable). At present we know only 
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two examples: 

(1) if f(x) = c, then /is integrable on [a, b] and J* f — c • (b — a). 
(Notice that this integral assigns the expected area to a rectangle.) 

(2) if /(*) = ( ^' * irratlonal then y [ s not integrable on [a, b]. 

I 1, x rational, 

Several more examples will be given before discussing these problems fur- 
ther. Even for these examples, however, it helps to have the following simple 
criterion for integrability stated explicitly. 

THEOREM 2 If / is bounded on j>, b], then / is integrable on [a, b] if and only if for every 
S > 0 there is a partition P of [a, b] such that 

U(f, P) - L(f, P) < s. 

PROOF Suppose first that for every s > 0 there is a partition P with 

U(f, P) - L(f, P) < e. 

Since 

vai\U<J,F)\ < U(f,P), 
supjL(/,P')} >L{f,P), 

it follows that 

inf {£/(/, P')} - sup {£(/,/>')} <£ 

Since this is true for all £ > 0, it follows that 

sup {L(f,P')} =inf{t/(/,P')}; 

by definition, then, / is integrable. The proof of the converse assertion is simi- 
lar. If / is integrable, then 

sup \L{f,P)} = -wS{U{f,T)). 

This means that for each e > 0 there are partitions P', P" with 

U(f, P") - L(f, P') < e. 

Let P be a partition which contains both P' and P". Then, according to the 
lemma, 

U(J, P) < U(f, P"), 

L(f, P) > L(f, P'); 

consequently, 

U(f, P) - L(f, P) < U(J, P") - L(f, P') < s. | 

Although the mechanics of the proof take up a little space, it should be clear 
that Theorem 2 amounts to nothing more than a restatement of the definition 
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of integrability. Nevertheless, it is a very convenient restatement because there 
is no mention of sup's and inf s, which are often difficult to work with. The 
next example illustrates this point, and also serves as a good introduction to 
the type of reasoning which the complicated definition of the integral necessi- 
tates, even in very simple situations. 
Let / be defined on [0, 2] by 

:-\. 

Suppose P = {*o, . . • , t n ] is a partition of [0, 2] with 

tj-! < 1 < t } 

(see Figure 8). Then 

mi = Mi = 0 if i ^ /, 

but 

mj — 0 and Mj = 1. 

Since 



t=J+l 
we have 

U(f, P) - L(f 9 P) = tj - h-x. 

This certainly shows that / is integrable: to obtain a partition P with 

U(f, P) - L(f, P) < e, 

it is only necessary to choose a partition with 

t,-i < 1 < tj and tj — tj-i < s. 

Moreover, it is clear that 

L(J, P) < 0 < U(f, P) for all partitions P. 

Since / is integrable, there is only one number between all lower and upper 
sums, namely, the integral of /, so 

f/ = o. 

Jo 

Although the discontinuity of / was responsible for the difficulties in this 
example, even worse problems arise for very simple continuous functions. For 
example, let /(#) = x, and for simplicity consider an interval [0, b], where 
b > 0. If P = {t^ . . . , t n ) is a partition of [0, b\ then (Figure 9) 

mi — and Af»- = U 



and therefore 

n 

L(f, P) = 2 ti-iCh - 

t = l 

= to(h - t 0 ) + h(t 2 - h) + • • • + * n _i(*„ - f„_i), 
n 

U(f, P) = ^ U(U - ti-x) 

t = 1 

Neither of these formulas is particularly appealing, but both simplify con- 
siderably for partitions P n = {^ 0 , ■ • . , t n ) into equal subintervals. In this 
case, the length U — of each subinterval is b/n f so 



in general, 



Then 



to = 


o, 




ft 


h = 


— > 




n 




2b 


< 2 = 


— > etc; 




n 




ib 


ti = 






n 


n 





Uf, Pn) = ^ /,-l(<< - /<-l) 



n-l 

-m 

J — o 

Remembering the formula 

1+ ... +A _*C*±2>, 

2 

this can be written 

= " - 1 . b _l. 

n ' 2 
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Similarly, 

n 

U(f, Pn) = ^ - 

= V - • - 

= n(n + 1) ^ 

2 * rz 2 

= * + 1 . h l. 
n * 2 

If * is very large, both L(f, P n ) and U(f, P n ) are close to b 2 /2, and this remark 
makes it easy to show that / is integrable. Notice first that 

U(f, P n ) - L(f, />„)=-• 

This shows that there are partitions P n with £/(/, P n ) - L(f, P n ) as small as 
desired. By Theorem 2 the function / is integrable. Moreover, J q f may now 
be found with only a little work. It is clear, first of all, that 

L(f, P n ) < | < U(f, Pn) for all n. 

This inequality shows only that b 2 /2 lies between certain special upper and 
lower sums, but we have just seen that U(f, P n ) - Uf, Pn) can be made as 
small as desired, so there is only one number with this property. Since the 
integral certainly has this property, we can conclude that 

jT'-r 

Notice that this equation assigns area b 2 /2 to a right triangle with base and 
altitude b (Figure 10). Using more involved calculations, or appealing to 
Theorem 4, it can be shown that 




2 2 



The function f(x) = x 2 presents even greater difficulties. In this case 
(Figure 11), if P = {t 0 , . . . , t n } is a partition of [0, b\ then 

mi = /(<*_!) = fe_i) 2 and Mi = f(ti) = k 2 . 

Choosing, once again, a partition P» = {fo, . - . , **} into « equal parts, 
so that 



the lower and upper sums become 



Uf, P.) 



U(f, Pn) 



Recalling the formula 

1" +••*+*■ — + 1)(2* + 1) 
from Problem 2-1, these sums can be written as 

=V7(»-D(»)(2«-1), 
rr 6 

f/(/,P») =-'^»(«+l)(2« + l). 
w s 6 

It is not too hard to show that 

L(f, P n ) < y < U(f, P n ), 

and that U(f, P n ) - L(f, P n ) can be made as small as desired, by choosing n 
sufficiently large. The same sort of reasoning as before then shows that 

Jo J 3 

This calculation already represents a nontrivial result — the area of the region 
hounded by a parabola is not usually derived in elementary geometry. Never- 
theless, the result was known to Archimedes, who derived it in essentially the 
same way. The only superiority we can claim is that in the next chapter we 
will discover a much simpler way to arrive at this result. 



n 

£<■•-<>'-;•- 

Z-/ n 2 n 

i = l 

n-l 

n 

^ k 2 * {U - fa-i) 
L4 n 2 n 
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Some of our investigations can be summarized as follows: 
j f = c ' (b — a) if f(x) = c for all *, 



£2 ^2 

/ = — - - if /(*) = * for all *, 

/ = *! ~ ^ 3 if /(*) = for all x 

3 3 3 



This list already reveals that the notation j* f suffers from the lack of a con- 
venient notation for naming functions defined by formulas. For this reason an 
alternative notation,* analogous to the notation lim /(#), is also useful: 

J* f(x) dx means precisely the same as j* f. 

Thus 

rb 

c dx = c • (b — a), 



6 2 a 2 
x ax = — > 

2 2 

x 2 dx = - 

3 3 



Notice that, as in the notation lim /(*), the symbol x can be replaced by any 

x—*a 

other letter (except /, or 6, of course) ; 

* = p(t) dt = /;/(«) <** = /;/« <*» = *. 

The symbol has no meaning in isolation, any more than the symbol x— > 
has any meaning, except in the context lim /(*). In the equation 



x 2 dx = °—i 

3 3 



the <?nf*re symbol x 2 dx may be regarded as an abbreviation for: 
the function / such that /(*) = x 2 for all x. 

* The notation J & /M dx is actually the older, and was for many years the only, symbol for 

the integral. Leibniz used this symbol because he considered the integral to be the sum 
(denoted by J) of infinitely many rectangles with height /(*) and "infinitely small" width dx. 
Later writers used x 0 , . . . , x n to denote the points of a partition, and abbreviated Xi — 

n 

by Axi. The integral was defined as the limit as Ax { approaches 0 of the sums ^ /(*»•) Ax { 

i = i 



(analogous to lower and upper sums). The fact that the limit is obtained by changing 2 to /, 
f(xi) to /(*), and Axi to dx, delights many people. 
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(2) 
(3) 



This notation for the integral is as flexible as the notation lim fix). Several 

x— >a 

examples may aid in the interpretation of various types of formulas which 
frequently appear; we have made use of Theorems 5 and 6.* 

rb rb rb k2 a 2 

(1) / ( x +y)dx= / xdx+ / ydx = -~--+y(b-a). 

Ja Ja Ja £ £ 

fx fx fx x i a 2 

(y + t)dy= jjdy + ^ t dy = - - - + t(x - a). 

Ja (fa (1 + ^ dZ ) dX = la (1 + ~ ^ dX 
= (1 + 0 j' (x - a) dx 

= (i+4f-?-«(*-4 

(4) f(f (,+,)*)*- £[x {d -c )+ <l-l]dx ^ 

= (~- C ^(b-a) + (d-c) f\dx 

The computations of f* x dx and j* x 2 dx may suggest that evaluating 

integrals is generally difficult or impossible. As a matter of fact, the integrals 
of most functions are impossible to determine exactly (although they may be com- 
puted to any degree of accuracy desired by calculating lower and upper sums). Neverthe- 
less, as we shall see in the next chapter, the integral of many functions can be 
computed very easily. 

Even though most integrals cannot be computed exactly, it is important 
at least to know when a function / is integrable on [a, b\ Although it is possible 
to say precisely which functions are integrable, the criterion for integrability 
is a little too difficult to be stated here, and we will have to settle for partial 
results. The most useful result will be stated now, but proved at the end of the 
next chapter. 

THEOREM 3 If / is continuous on [a, b], then / is integrable on [a, b]. 

(Notice that it is unnecessary to assume that / is bounded on [a, b\ because of 
continuity.) 

* Lest chaos overtake the reader when he reads other books, equation (1) requires an impor- 
tant qualification. This equation interprets / y dx to mean the integral of the function / such 

f & 

that each value /(*) is the number^. But classical notation often uses y for_y(x), so / y dx 
might mean the integral of some arbitrary function y. 
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Although this theorem will provide all the information necessary for the use 
of integrals in this book, it is more satisfying to have a somewhat larger supply 
of integrable functions. Several problems treat this question in detail. It will 
help to know the following three theorems, which show that / is integrable on 
[a, b], if it is integrable on [a, c] and [c, b]; that / + g is integrable if /andg are; 
and that c • / is integrable if / is integrable and c is any number. 

As a simple application of these theorems, recall that if / is 0 except at one 
point, where its value is 1 , then / is integrable. Multiplying this function by c, it 
follows that the same is true if the value of / at the exceptional point is c. 
Adding such a function to an integrable function, we see that the value of an 
integrable function may be changed arbitrarily at one point without destroy- 
ing integrability. By breaking up the interval into many subintervals, we see 
that the value can be changed at finitely many points. 

The proofs of these theorems usually use the alternative criterion for inte- 
grability in Theorem 2; as some of our previous demonstrations illustrate, the 
details of the argument often conspire to obscure the point of the proof. It is a 
good idea to attempt proofs of your own, consulting those given here as a 
last resort, or as a check. This will probably clarify the proofs, and will cer- 
tainly give good practice in the techniques used in some of the problems. 

THEOREM 4 Let a < c < b. If / is integrable on [a, b\ then / is integrable on [a, c] and on 
[c, b]. Conversely, if /is integrable on [a, c] and on [c, b], then /is integrable on 
[a, b]. Finally, if / is integrable on [a, b], then 

/>-/:/+/> 

Suppose/ is integrable on [a, b].If£ > 0, there is a partition P = {t Q , . . . , t n } 
of [a, b] such that 

U(f, P) - £(/, P) < e. 

We might as well assume that c = tj for some /. (Otherwise, let Q be the 
partition which contains t 0 , . . . , t n and c; then Q contains P, so £/(/, Q) - 
L(f, Q) < U(f, P) - L(f, P) < e.) 

Now P = {/ 0 , . . . , tj} is a partition of [a, c] and P" = {*,-, . . . , *»} is 
a partition of [c, b] (Figure 12). Since 

a/, p) = us, n + uf, n, 

U(J, P) = U(f, P') + U(J, P"), 

we have 

[U(f, P') - Uf, P')] + [u(f, p") - Uf, P")} = u(f, p) - Uf, p) < «• 

Since each of the terms in brackets is nonnegative, each is less than e. This 
shows that / is integrable on [a, c] and [c, b]. Note also that 

Uf,n < p<u(f,p'), 
Uf, p") < f*f < u(f, P"), 



PROOF 
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so that 

L{f,P) < f o b f+ f b °f<U(f,P). 
Since this is true for any P, this proves that 

/:/+/;/-/.*/• 

Now suppose that / is integrable on [a, c] and on [c, b]. If £ > 0, there is a 
partition P' of [a, c] and a partition P" of [c, b] such that 

U(f, P') - L(f, P') < 6/2, 
U{f, P") - L(f, P") < e/2. 

If P is the partition of [a, b] containing all the points of P' and P", then 

L(f, P) = L(f, P') + L(f, P"), 
U(f,P) = U(f,P') + U(f,P"); 

consequently, 

U(f, P) - L(f, P) = [U(f, P') - L(f, P')] + [U(f, P") - L(f, />")] < e. I 

Theorem 4 is the basis for some minor notational conventions. The integral 
J a f was defined only for a < b. We now add the definitions 

/;/=0 and ///--/;/ if«>*. 

With these definitions, the equation fcf+ f*f = f*f holds for all a, c, b 
even if a < c < b is not true (the proof of this assertion is a rather tedious 
case-by-case check). 

THEOREM 5 If / and g are integrable on [a, b], then / + g is integrable on [a, b] and 

//(/+*)-/:/+/> 

PROOF Let P = {*<>, . • - , U be any partition of [>, £]. Let 

mi = inf {(/ + g)(x): t^i < x < ti\, 
m/ = inf j/0): < * < fe}, 
m/ r = inf \g(x): t^ x < x < t-), 

and define M iy M/, M" similarly. It is not necessarily true that 

rrii — m/ + m/', 

but it is true (Problem 7) that 

rrii > m/ + m/'. 

Similarly, 

Mi < Mi + Mi". 
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Therefore, 

L(f,P)+L(g, P)<L(J + g,P) 

and 

U(f + g, P) < U(f,P) + U(g, P). 

Thus, 

Uf, P) + Ug, P) < Uj + g,P)< U(J + g,P)< U(f, P) + U(g, P). 
Since / and g are integrable, there are partitions P', P" with 

U(f, P') - US P') < 8/2, 
U(g, P") - Ug, P") < s/2. 

If P contains both P' and P", then 

U(f, P) + U(g, P) - [Uf, P) + Ug, P)] < «, 

and consequently 

U(f + g,P) -L(f + g,P)< S. 
This proves that / + g is integrable on [a, b\ Moreover, 

(1) US P) + Lis, P) ^ L (f + s, P) 

</;(/+,) 

< U(f + g,P) < U(f,P) + U{g,P); 

and also 

(2) Uf, P) + Ug, P) < \ b J +f a g< Wf, P) + u(g, P). 

Since US, P) ~ Uf, P) and U{g, p) - Ug, P) can both be made as small as 
desired, it follows that 

u(f, p) + u(g, P) - [Uf, P) + Ug, P)] 

can also be made as small as desired; it therefore follows from (1) and (2) that 

/:</+*> -/:/+/>• 

THEOREM 6 If / is integrable on [a, b], then for any number c, the function cf is integrable 
on [a, b] and 

proof The proof (which is much easier than that of Theorem 5) is left to you. It is a 
good idea to treat separately the cases c > 0 and c < 0. Why? | 

(Theorem 6 is just a special case of the more general theorem that / • g is 
integrable on [a, b], if / and g are, but this result is quite hard to prove 
(see Problem 32).) 

In this chapter we have acquired only one complicated definition, a tew 
simple theorems with intricate proofs, and one theorem with no proof at all. 
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THEOREM 7 



PROOF 




c+h)-F(c) 



c c + h 



FIGURE 13 



THEOREM 8 



PROOF 



This is not because integrals constitute a more difficult topic than derivatives, 
but because powerful tools developed in previous chapters have been allowed 
to remain dormant. The most significant discovery of calculus is the fact that 
the integral and the derivative are intimately related—once we learn the con- 
nection, the integral will become as useful as the derivative, and as easy to use. 
The connection between derivatives and integrals deserves a separate chapter, 
but the preparations which we will make in this chapter may serve as a hint. 
We first state a simple inequality concerning integrals, which plays a role in 
many important theorems. 

Suppose / is integrable on [a, b] and that 

m < f(x) < M for all x in [a, b]. 



Then 



i(b - a) < J a b f<M(b - a). 



It is clear that 

m(b -a)< L(f, P) and U(f, P) < M(b - a) 

for every partition P. Since J* f = sup {£(/, P)\ = inf {£/(/, P)}, the desired 
inequality follows immediately. | 

Suppose now that / is integrable on [a, b]. We can define a new function F 
on [a, b] by 

f{x) = /;/ = /;/(*) dt. 

(This depends on Theorem 4.) We have seen that /may be integrable even if 
it is not continuous, and the Problems give examples of integrable functions 
which are quite pathological. The behavior of F is therefore a very pleasant 
surprise. 

If / is integrable on [a, b] and F is defined on [a, b] by 

f(x) = /;/, 

then F is continuous on [a, b]. 

Suppose c is in [a, b\. Since / is integrable on [a, b] it is, by definition, bounded 
on [a, b]; let M be a number such that 

|/(*)| < M for all x in [a, b\ 
If h > 0, then (Figure 13) 

f(, + a)-f ( ,) = /; + v-/;/ = /; + V. 

—M < f(x) < M for all x, 



Since 





/ t 




— 1 




a ^J- 



F 



f 

FIGURE 14 

it follows from Theorem 7 that 

-Af 'A< j c C+h f<Mh; 

in other words, 

(1) — Af • h < F(c + h) - < AT- A. 




If h < 0, a similar inequality can be derived. Note that 

Applying Theorem 7 to the interval 0 + h, c], of length —h, we obtain 

MA < f e f < -Mh- 

Jc + h 

multiplying by — 1, which reverses all the inequalities, we have 

(2) Mh < F{c + h) - F{c) < -Mh. 
Inequalities (1) and (2) can be combined: 

\F{c + h) - F(c)\ < M - \h\. 
Therefore, if £ > 0, we have 

\F{c + h) - F(c)\ < e, 
provided that \h\ < e/M. This proves that 

lim F(c + h) = F(c); 

in other words F is continuous at c. \ 

Figure 14 compares / and F(x) = J* f for various functions /; it appears 

that F is always better behaved than /. In the next chapter we will see how 
true this is. 

PROBLEMS 

1. Prove that J* x z dx = b 4 /4, by considering partitions into n equal sub- 

n 

intervals, using the formula for ^ i z which was found in Problem 2-5. 

i = i 

This problem requires only a straightforward imitation of calculations 
in the text, but you should write it up as a formal proof to make certain 
that all the fine points of the argument are clear. 

2. Prove, similarly, that J* x 4 dx = b b /5. 

n 

*3. (a) Using Problem 2-6, show that Y k p /n p+1 can be made as close 

* = i 

to l/(p + 1) as desired, by choosing n large enough, 
(b) Prove that j* x* dx = b p+l /{p + 1). 
4. Decide which of the following functions are integrable on [0, 2], and 
calculate the integral when you can. 

/ • \ r, \ ( X, 0 < X < 1 

(0 /W = U-2, 1< X <2. 
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(ii) /(*) 



(v) f{x) 



x, 0 < x < 1 

x - 2, 1 < * < 2. 
(iii) /(*) = * + [x]. 
/• \ /■/ \ f * + [*], * rational 
(1V) /W = ( 0, * irrational. 

1, # of the form a + b for rational # and b 
0, * not of this form. 
1 



(vi) f{x) = [i] 



0 < * < 1 



0, * = 0 or * > 1. 
(vii) / is the function shown in Figure 15. 

5. Find the areas of the regions bounded by 

x 2 

(i) the graphs of fix) = x 2 and = — + 2. 

(ii) the graphs of fix) = x 2 and g(x) = — x 2 and the vertical lines 
through (-1, 0) and (1, 0). 

(iii) the graphs of fix) — x 2 and g(#) = 1 — x 2 . 

(iv) the graphs of /(*) = x 2 and = 1 - x 2 and hix) = 2. 

(v) the graphs of /(*) = a: 2 and g(x) = x 2 - 2x + 4 and the vertical 
axis. 

(vi) the graph of fix) = V*, the horizontal axis, and the vertical line 
through (2, 0). (Don't try to find | q 2 you should see a way 
of guessing the answer, using only integrals that you already know 
how to evaluate. The questions that this example should suggest are 
considered in Problem 16.) 

6. Find 

I!Uc f^siy)dy)dx 

in terms of j b f and f d g. (This problem is an exercise in notation, with 
a vengeance; it is crucial that you recognize a constant when it appears.) 

7. Prove, using the notation of Theorem 5, that 



m. 



:/ + mi" = inf {/(a) + g(x 2 ): < *i, *2 < **} < m f . 



8. (a) Which functions have the property that every lower sum equals 



every upper sum? 



(b) Which functions have the property that some upper sum equals 

some (other) lower sum? 

(c) Which continuous functions have the property that all lower sums 
are equal? 



234 Derivatives and Integrals 



*(d) Which integrable functions have the property that all lower sums 
are equal? (Bear in mind that one such function is f(x) = 0 for x 
irrational, f(x) = 1 /q for x — p/q in lowest terms.) Hint: You will 
need the notion of a dense set, introduced in Problem 8-6, as well as 
the results of Problem 21. 

9. Ha<b<c<d and / is integrable on [a, d\ prove that / is integrable 
on [b, c]. (Don't work hard.) 

10. (a) Prove that if / is integrable on [a, b] and f(x) > 0 for all x in [a, b], 

then f* f > 0. 

(b) Prove that if /and g are integrable on [a, b~\ and f(x) > g(x) for all x 
in [a, b\ then J a f > g> (By now it should be unnecessary to 
warn that if you work hard on part (b) you are wasting time.) 

11. Prove that 

I! X*) J* = f(* - <) d*. 

(The geometric interpretation should make this very plausible.) Hint: 
Every partition P = { t 0 , . . . , t n \ of [a, b] gives rise to a partition 
P' = {to + c, ♦ • • , t n + c] of [a + c, b + c], and conversely. 

*12. Prove that 

fa l rb\ fab I 

~dt + I -dt = -dt. 
Ji t Ji t Ji t 

Hint: This can be written j"\/tdt = j* h \/tdt. Every partition 
P = {t 0 , . . . , t n } of [1 , a] gives rise to a partition P r = {bt 0 , . . . , bt n \ 
of [b, ab], and conversely. 
*13. Prove that 

j c l b f(t) dt = e £ f(ct) dt. 
(Notice that Problem 12 is a special case.) 

14. Suppose that /is bounded on [a, b] and that /is continuous at each point 
in [a, b] with the exception of # 0 in (a, b). Prove that / is integrable on 
[a, b]. Hint: Imitate one of the examples in the text. 

15. Suppose that / is nondecreasing on [a, b]. Notice that / is automatically 
bounded on [a, b], because f(a) < f(x) < f(b) for x in [a, b\ 

(a) If P = {fo, ...,*»} is a partition of [a, b], what is L(f, P) and 
U(f, P)? 

(b) Suppose that k - = d for each i. Prove that U(f, P) - L(f, P) 
= 8[f(b) -/(«)]. 

(c) Prove that / is integrable. 

(d) Give an example of a nondecreasing function on [0, 1] which is 
discontinuous at infinitely many points. 
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It might be of interest to compare this problem with the following 
extract from Newton's Principia.* 

LEMMA II 

If in any figure AacE, terminated by the right lines Aa, AE, and the curve 
acE, there be inscribed any number of parallelograms Ab, Be, Cd, &c, com- 
prehended under equal bases AB, BC, CD, &c, and the sides, Bb, Cc, Dd, 
&c, parallel to one side Aa of the figure; and the parallelograms aKbl, 
bLcm, cMdn, &c, are completed: then if the breadth of those parallelograms 
be supposed to be diminished, and their number to be augmented in infinitum, 
/ say, that the ultimate ratios which the inscribed figure AKbLcMdD, the 
circumscribed figure AalbmcndoE, and curvilinear figure AabcdE, will have 
to one another, are ratios of equality. 

For the difference of the inscribed and circumscribed figures is the 
sum of the parallelograms Kl, Lm, Mn, Do, that is (from the equality 
of all their bases), the rectangle under one of their bases Kb and the 
sum of their altitudes Aa, that is, the rectangle ABla. But this rec- 
tangle, because its breadth AB is supposed diminished in infinitum, 
becomes less than any given space. And therefore (by Lem. 1) the 
figures inscribed and circumscribed become ultimately equal one to 
the other; and much more will the intermediate curvilinear figure be 
ultimately equal to either. Q.E.D. 

*16. Suppose that /is increasing. Figure 16 suggests that 

fr = rw -ama)- /;;;:/. 

(a) If P = {h, . . . , t n ) is a partition of [a, b], let P' = [f~Kt Q ), . . . . 
f~ l {t n )\. Prove that, as suggested in Figure 17, 

L{f~\ P) + U(f, P f ) = bf~Kb) - af~Ka). 

(b) Now prove the formula stated above. 

(c) Find j* V* dx for 0 < a < b. 

17. A function s defined on [a, b] is called a step function if there is a parti- 
tion P = {t Q , . . . , *„} of [a, b] such that s is constant on each 0 
(the values of s at h may be arbitrary). 

(a) Prove that if / is integrable on [a, b], then for any s > 0 there is a 
step function si < f with f* f - J* si < e, and also a step function 

^ 2 > / with s 2 — J a f < e. 

(b) Suppose that for all s > 0 there are step functions si < f and 
^ 2 > / such that J* s 2 - f* Si < e. Prove that / is integrable. 

* Newton's Principia, A Revision of Mott's Translation, by Florian Cajori. University of Cali- 
fornia Press, Berkeley, California, 1946. 



(c) Find a function / which is not a step function, but which satisfies 
j f = L(f, P) for some partition P of [a, b]. 

18. Prove that if / is integrabie on [a, b], then for any £ > 0 there is a con- 
tinuous function g < f with f — g < £. Hint: First get a step 
function with this property, and then a continuous one. A picture will 
help immensely. 

19. (a) Show that if Si and s 2 are step functions on [a, b], then si + s 2 is also. 

(b) Prove, without using Theorem 5, that (si + s 2 ) = J a Si + J a s 2 . 

(c) Use part (b) (and Problem 17) to give an alternative proof of 
Theorem 5. 

20. Suppose that / is integrabie on [a, b]. Prove that there is a number x in 
[a, b] such that J* f = f. Show by example that it is not always possi- 
ble to choose x to be in (a, b). 

21. The purpose of this problem is to show that if / is integrabie on [a, b], 
then / must be continuous at many points in [a, b]. 

(a) Let P = {/ 0 , . • • , t n ] be a partition of [0, 1] with U(f, P) - 
L(f, P) < b — a. Prove that for some i we have Mi — mi < 1. 

(b) Prove that there are numbers a\ and b\ with a < a\ < b\ < b and 
sup {/(*): ai < * < bi} — inf {/(#): ai < x < bi) < 1. (You can 
choose [ai, bi] = /J from part (a) unless i = 1 or n; and in these 
two cases a very simple device solves the problem.) 

(c) Prove that there are numbers a 2 and b 2 with a\ < a 2 < b 2 < bi and 
sup {/(*): a 2 < x < b 2 ] - inf \f(x): a 2 < x < b 2 } < i. 

(d) Continue in this way to find a sequence of intervals I n = [a n , b n ] 
such that sup {/(*): a: in 7 n } - inf \f(x): x in I n ) < 1/n. Apply the 
Nested Intervals Theorem (Problem 8-14) to find a point x at which 
/ is continuous. 

(e) Prove that / is continuous at infinitely many points in [a, b], 

22. Recall, from Problem 10, that f*f > 0 if /(*) > 0 for all x in [a, b\ 

(a) Give an example where f(x) > 0 for all x, and f(x) > 0 for some x in 
[a, b\ and f* f = 0. 

(b) Suppose f(x) > 0 for all x in [«, b] and / is continuous at * 0 in [a, b] 
and f(x 0 ) > 0. Prove that f > 0. Hint: It suffices to find one 

lower sum L(f, P) which is positive. 

(c) Suppose / is integrabie on [a, b] and f(x) > 0 for all x in [a, b]. 
Prove that j b f > 0. Hint: You will need Problem 21; indeed that 
was one reason for including Problem 21. 
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*23. (a) Suppose that / is continuous on [a, b] and f* fg = 0 for all con- 
tinuous functions ^ on [a, b]. Prove that / = 0. (This is easy; there 
is an obvious g to choose.) 
(b) Suppose / is continuous on [a, b] and that J fg = 0 for those con- 
tinuous functions g on [a, b] which satisfy the extra conditions 
g(a) = g(b) = 0. Prove that / = 0. (This innocent looking fact is 
an important lemma in the calculus of variations; see the Suggested 
Reading for references.) Hint: Derive a contradiction from the 
assumption f(x Q ) > 0 or f(x 0 ) < 0; the g you pick will depend on 
the behavior of / near x 0 . 
24. Let f(x) — x for x rational and f(x) = 0 for x irrational. 

(a) Compute L(f, P) for all partitions P of [0, 1]. 
(bj Find inf {£/(/, P):Pa partition of [0, 1]}. 

*25. Let f(x) = 0 for irrational x, and \/q if x — p/q in lowest terms. Show 
that / is integrable on [0, 1] and that J Q f = 0. (Every lower sum is 

clearly 0; you must figure out how to make upper sums small.) 
*26. Find two functions / and g which are integrable, but whose composition 
g o f is not. Hint: Problem 25 is relevant. 

27. (a) Prove that if m < f(x) < M for all x in [a, b], then 

f*f(x) dx = (b - a) ii 

for some number jjl with m < fx < M. 

(b) Prove that if / is continuous on [a, b], then 

j b J{x) dx= (b- a)M) 

for some J in [a, b]; and show by an example that continuity is 
essential. This fact is called the (First) Mean Value Theorem for 
Integrals. 

28. (a) Suppose that / is continuous on [a, b] and that g is integrable and 

nonnegative on [a, b]. Prove that 

\l '/(*)*(*) dx = /(*) \lg(x)dx 

for some J in [a, b]. This result is called the Second (or Generalized) 
Mean Value Theorem for Integrals. Hint: The inequality 
< f(x) < M implies that mg(x) < f(x)g(x) < Mg(x), since g is 
nonnegative. 

(b) Show that the hypothesis for g is essential. (Tryg(*) = # on [— 1, 1].) 

The First and Second Mean Value Theorems for integrals will be used (in a 
not very essential way) in Chapter 19. The result of the next problem, which 
I have cribbed from several older calculus texts, is called the Third Mean 
Value Theorem for Integrals. To be quite frank, I haven't the slightest idea 
what it is good for. 
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*29. (a) Suppose that g is increasing on [a, b] and that / is integrable on 
[a, b]. Prove that there is a number £ in [a, b] such that 

p(t)g(t) dt = g{a) ///(<) dt + g(b) f*f(t) dt. 

Hint: What is the value of the right side for £ = a and for £ = b? 
(b) Show that the hypothesis on g is essential. (Try g(a) = g(b) = 0.) 
*30. Let / be a bounded function on [a, b] and let P be a partition of [a, b]. 
Let Af t and rrii have their usual meanings, and let M/ and m/ have the 
corresponding meanings for the function |/|. 

(a) Prove that 

M/ = max(|Af<[, \rrii\), 
m/ = min(|Afi|, |iw,-|). 

(b) Prove that Af/ — m/ < Mi — Hint: You will have to consider 
two separate cases, because that's how max and min are defined. 

(c) Prove that if / is integrable on [a, b], then so is |/|. 

(d) Prove that if / and g are integrable on [a, b], then so are max(/, g) 
and min(/, g). 

(e) Prove that / is integrable on [a, b] if and only if its "positive part" 
max(/, 0) and its "negative part" min(/, 0) are integrable on [a, b]. 

31. Prove that if / is integrable on [a, b], then 

|/.Vw*|< Jl i/w i dt. 

Hint: This follows easily from a certain string of inequalities; Problem 
1-14 is relevant. 

*32. Suppose / and g are integrable on [a, b] and f{x) > 0 for all x in [a, b]. 
Let P be a partition of [a, b]. Let M/ and m/ denote the appropriate 
sup's and inf s for /, define M" and m/' similarly for g, and define Mi 
and mi similarly for fg. 

(a) Prove that M { < M-M" and m { > m/m"- 

(b) Show that 

n 

U(fg, P) - L(fg, P)<2 [M/M/' - m/m/'^U - /,•_,). 

i = l 

(c) Using the fact that / and g are bounded, so that |/(*)|, < M 
for x in [a, b], show that 

U(fg, P) - L(fg, P) 

n n 

< M { \ [Mi' - m/](ti - t^) + T [Mi" - m/ f ](ti - fc_0 }. 
t=i t=i 

(d) Prove that /g is integrable. 

(e) Now eliminate the restriction that fix) > 0 for x in [a, b]. 
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33. Suppose that / and g are integrable on [a, b]. The Cauchy -Schwartz 
inequality states that 

(/»(/>> 

(a) Prove the Gauchy-Schwartz inequality by imitating one of the 
proofs of the Schwartz inequality in Problem 1-18. 

(b) If equality holds, is it necessarily true that f = \g for some X ? What 
if / and g are continuous? 

(c) Show that the Schwartz inequality is a special case of the Cauchy- 
Schwartz inequality. 

(d) Prove that^ 1 /) 2 < (J* f 2 )- Is this result true if 0 and 1 are 
replaced by a and b ? 

*34. Suppose that / is continuous and lim /(*) — a. Prove that 

X — ► oo 

1 f X 

lim - / f{t) dt = a. 
Hint: The condition lim f(x) = a implies that fit) is close to a for 

x — * 00 

f N + M 

t > some N. This means that / /(f) dt is close to Afa. If M is large 
in comparison to N, then Ma/ (N + M) is close to a. 
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THEOREM 1 (THE FIRST 
FUNDAMENTAL THEOREM 
OF CALCULUS) 



From the hints given in the previous chapter you may have already guessed 
the first theorem of this chapter. We know that if / is integrable, then F(x) = 
f a f is continuous; it is only fitting that we ask what happens when the 
original function / is continuous. It turns out that F is differentiate (and its 
derivative is especially simple). 

Let / be integrable on [a, b], and define F on [a, b] by 

*w = I j. 

Iff is continuous at c in [a, b], then F is differentiate at c, and 

F'{c) =/(,). 

(If c = a or b, then F'(c) is understood to mean the right- or left-hand deriva- 
tive of F.) 



PROOF We will assume that c is in {a, b) ; the easy modifications for c = a or b may be 
supplied by the reader. By definition, 

F'(c)=l^ F{c + h) - F ^. 

A-+0 h 

Suppose first that h > 0. Then 

F(c + h)-F(c) = f; +k f. 

Define m h and M h as follows (Figure 1): 

m h = inf {/(*): c < x < c + h], 
M h = sup \f(x): c < x < c + h\. 

It follows from Theorem 13-7 that 



Therefore 



[c + h 

h< J c f<M h -h. 



^ F(c + ti) — F(c) 
n 

If h < 0, only a few details of the argument have to be changed. Let 

m h = inf {/(*): c + h < x < c], 
M h = sup {/(*): c + h < x < c\. 

240 
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FIGURE 1 



Then 

m h - {-h) < f c C +h f<M h -(-h). 

Since 

F {c+h)-F(c) = f: +h f= -f; + j, 

this yields 

m h • h > F{c + h) - F{c) > Mh ' h. 

Since h < 0, dividing by h reverses the inequality again, yielding the same 
result as before: 

F{c + h) - F{c) 

m h < ; < M h . 

h 

This inequality is true for any integrable function, continuous or not. Since 
/ is continuous at c, however, 

lim m h = lim M h — f(c), 

and this proves that 

F'(c) = lim F(c + h)-F{c) _ t 

h-yO k 

Although Theorem 1 deals only with the function obtained by varying the 
upper limit of integration, a simple trick shows what happens when the lower 
limit is varied. If G is defined by 

CM - /„*/, 

then 

= /:/-/:/• 
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Consequently, if / is continuous at c, then 

G\c) = -/(,). 

The minus sign appearing here is very fortunate, and allows us to extend 
Theorem 1 to the situation where the function 

*w = /;/ 

is defined even for x < a. In this case we can write 

™ = - /;/, 

so if c < a we have 

F'(c) = -(-/(c)) = /(,), 

exactly as before. 

Notice that in either case, differentiability of F at c is ensured by continuity 
of / at c alone. Nevertheless, Theorem 1 is most interesting when / is con- 
tinuous at all points in [a, b]. In this case F is differentiable at all points in 
[a, b] and 

F'=f. 

In general, it is extremely difficult to decide whether a given function / is the 
derivative of some other function; for this reason Theorem 11-7 and Darboux's 
Theorem (Problem 11-39) are particularly interesting, since they reveal cer- 
tain properties which / must have. If / is continuous, however, there is no 
problem at all — according to Theorem 1, / is the derivative of some function, 
namely, the function 

*w = /."/• 

Theorem 1 has a simple corollary which frequently reduces computations 
of integrals to a triviality. 

COROLLARY If / is continuous on [a, b] and / = g r for some function g, then 

/.*/ = *(*)-*«. 

proof Let 

F{ X ) = /;/. 

Then F' = / = g' on [a, b]. Consequently, there is a number c such that 

F = g + c 

The number c can be evaluated easily: note that 

0 = F{a) = g{a) + c, 

so c = —g(a); thus 

F(x) = g(x) - g(a). 
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This is true, in particular, for x — b. Thus 

f*f = T(b) = g{b) - g(a). | 

The proof of this corollary tends, at first sight, to make the corollary seem 
useless: after all, what good is it to know that 

/.*/ = gib) - g(a) 

if g is, for example, g(x) = J* f ? The point, of course, is that one might happen 
to know a quite different function g with this property. For example, if 

x 3 

g(x) = - and f(x) = x\ 

then g'{x) — f(x) so we obtain, without ever computing lower and upper 
sums: 



dx — 



One can treat other powers similarly; if n is a natural number and g(x) = 
x n + l /(n + 1), then g'(x) = x n 3 so 



r 



x n dx = 



n + 1 n + 1 



For any natural number n, the function /(*) = a: n is not bounded on any 
interval containing 0, but if a and b are both positive or both negative, then 



f. 



b b~~ n+1 

-n dx = 



-72+1 -n + 1 



Naturally this formula is only true for n — 1 . We do not know a simple expression 
for 



a X 



The problem of computing this integral is discussed later, but it provides a 
good opportunity to warn against a serious error. The conclusion of Corollary 1 
is often confused with the definition of integrals — many students think that f 
is defined as: "g(b) — g(a), where g is a function whose derivative is /." This 
"definition" is not only wrong — it is useless. One reason is that a function / 
may be integrable without being the derivative of another function. For exam- 
ple, if /(*) = 0 for x 9* 1 and /(I) = 1, then / is integrable, but / cannot be a 
derivative (why not?). There is also another reason that is much more impor- 
tant: If / is continuous, then we know that / = g' for some function g; but we 
know this only because of Theorem 1. The function /(*) = \/x provides an excel- 
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THEOREM 2 (THE SECOND FUNDA- 
MENTAL THEOREM OF CALCULUS) 



PROOF 



lent illustration: if x > 0, then f(x) = g'(x) 9 where 

f x 1 

8(x) = h i dt > 

and we know of no simpler function g with this property. 

The corollary to Theorem 1 is so useful that it is frequently called the Sec- 
ond Fundamental Theorem of Calculus. In this book, that name is reserved for 
a somewhat stronger result (which in practice, however, is not much more 
useful). As we have just mentioned, a function / might be of the form g' even if 
/ is not continuous. If / is integrable, then it is still true that 

/„7 = &% - g(a). 

The proof, however, must be entirely different — we cannot use Theorem 1, so 
we must return to the definition of integrals. 

If / is integrable on [a, b] and / = g' for some function g, then 

/„7 = gW - g{a). 

Let P = {t 0i . . . , t n } be any partition of [a, b]. By the Mean Value Theorem 
there is a point X{ in /J such that 

g{k) - g{ti^) = g'(x t )(ti - t^) 

= f(Xi)(ti - k-l). 



If 

then clearly 
that is, 



rrii = inf {/(#): U-\ < x < k}, 
Mi = sup {/(#): U-\ < x < t{], 

rriiiti - ti_t) < f( Xi )(ti - t M ) < Mi(ti - t M ), 



rriiiti - U-i) < g(ti) — g(U-i) < Mi(U — 
Adding these equations for i = 1, . . . , n we obtain 

n n 

T nn(fi - ti-i) < gib) - g(a) < 2 Miih - <,_,) 

% = 1 i=l 

so that 

Uf, P) < gib) - g(a) < U(f, P) 
for every partition P. £ut this means that 

gib) - gia) = p. | 

We have already used the corollary to Theorem 1 (or, equivalently, 
Theorem 2) to find the integrals of a few elementary functions: 



b fon+l 

x n dx = 



n n+l 



n+\ n+ 1 



-' 72 7* -1. 



(a and b both positive or 
both negative if n < 0.) 
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As we pointed out in Chapter 1 3, this integral does not always represent the 
area bounded by the graph of the function, the horizontal axis, and the vertical 
lines through (a, 0) and (b, 0). For example, if a < 0 < b, then 

does not represent the area of the region shown in Figure 2, which is given 
instead by 




Similar care must be exercised in finding the areas of regions which are 
bounded by the graphs of more than one function — a problem which may 
frequently involve considerable ingenuity in any case. Suppose, to take a sim- 
ple example first, that we wish to find the area of the region, shown in Figure 3, 
between the graphs of the functions 

f(x) = x 2 and g(x) = x 3 

on the interval [0, I]. If 0 < x < 1, then 0 < x z < x 2 , so that the graph of g 
lies below that of /. The area of the region of interest to us is therefore 

area R(f, 0, 1) - area R(g, 0, 1), 

which is 

£ x 2 dx - \l x 3 dx = i - i = iV 
This area could have been expressed as 

/:</-„). 

If g (x) < fix) for all x in [a, b] , then this integral always gives the area bounded by 
/ and g, even if f and g are sometimes negative. The easiest way to see this is shown 
in Figure 4. If c is a number such that f + c and g + c are nonnegative on 
[a, b], then the region R h bounded by / and g, has the same area as the region 
i? 2 , bounded by / + c and g + c. Consequently, 

area R x = area R 2 = J* (f + c) — j* (g + c) 
= f a b L(f + c) - (g + c)] 

-/;(/-*)• 

This observation is useful in the following problem: Find the area of the 
region bounded by the graphs of 

f(x) = x 3 — x and g(x) = x 2 . 
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FIGURE 4 



The first necessity is to determine this region more precisely. The graphs of 
/ and g intersect when 

x 3 — x = x 2 , 
or x z — x 2 — x = 0, 
or #(# 2 — x — 1) = 0, 

n 1 + V5 1 - V5 

or * = 0 5 j 

2 2 

On the interval ([1 - V5]/2, 0) we have x s — x > x 2 and on the interval 
(0, [1 + V5]/2) we have * 2 > x 3 — a:. These assertions are apparent from 
the graphs (Figure 5), but they can also be checked easily, as follows. Since 
f(x) = g(x) only if x = 0, [1 + V5]/2 S or [1 Vs]/2, the function / - g 
does not change sign on the intervals ([1 — V5]/2, 0) and [0, [1 + V5]/2); 
it is therefore only necessary to observe, for example, that 



(-i) s 



v - (-*) - (-*) 2 = i> o, 

P _ 1 _ 12 = -1 < 0, 



to conclude that 



f-g>0 on ([1 - V5]/2, 0), 
f-g<0 on(0, [1 + V5]/2). 
The area of the region in question is thus 



/l Q -V5 " * ~ ^ + / 0 2 ^ 2 - (* 3 - *)1 ^« 



As this example reveals, one of the major problems involved in finding the 
areas of a region may be the exact determination of the region. There are, 
however, more substantial problems of a logical nature — we have thus far 
defined the areas of some very special regions only, which do not even include 
some of the regions whose areas have just been computed! We have simply 
assumed that area made sense for these regions, and that certain reasonable 
properties of "area" do hold. These remarks are not meant to suggest that you 
should regard exercising ingenuity to compute areas as beneath you, but are 
meant to indicate that a better approach to the definition of area is available, 
although its proper place is somewhere in advanced calculus. The desire to 
define area was the motivation, both in this book and historically, for the 
definition of the integral, but the integral does not really provide the best 
method of defining areas, although it is frequently the proper tool for computing 
them. 

It may be discouraging to learn that integrals are not suitable for the very 
purpose for which they were invented, but we will soon see how essential they 
are for other purposes. The most important use of integrals has already been 
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1 + V5 



FIGURE 5 



emphasized: if / is continuous, the integral provides a function y such that 



This equation is the simplest example of a "differential equation" (an equation 
for a function y which involves derivatives of y). The Fundamental Theorem 
of Calculus says that this differential equation has a solution, if /is continuous. 
In succeeding chapters, and in various problems, we will solve more compli- 
cated equations, but the solution almost always depends somehow on the 
integral; in order to solve a differential equation it is necessary to construct a 
new function, and the integral is one of the best ways of doing this. 

Since the differentiable functions provided by the Fundamental Theorem 
of Calculus will play such a prominent role in later work, it is very important 
to realize that these functions may be combined, like less esoteric functions, 
to yield still more functions, whose derivatives can be found by the Chain Rule. 

Suppose, for example, that 



Although the notation tends to disguise the fact somewhat, / is the composition 
of the functions 



In fact, /(*) = F(C(x)); in other words, f = F o C. Therefore, by the Chain 



/(*) =/«. 




C(x) = x s and 




Rule, 



fix) = F'(C(x)) • CM 
= F'(x*) • 3x 2 



1 + sin 2 x s 
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If / is defined, instead, as 

fa i 

= / i ■ • r* dt > 

Jx* 1 + sin 2 / 

then 

/'(*) = 1 • 3* 2 . 

7 w 1 + sin 2 x 3 

If / is defined as the reverse composition, 

\Ja 1 + sin 2 1 / 
f(x) = C(F(x)) • F'W 

~ 3 (/ 1 + sin 2 1 *) 1 + sin 2 x 



then 



Similarly, if 



/*sin x 1 

M = / : T ■ 

A 1 + sin 2 £ 

r° i 

J sin x 1 + sin 2 £ 

= sin ( [ X dt\ 
\Ja 1 + sin 2 f / 



then 



/'(#) = — * cos x, 

1 + sin 2 (sin x) 

g'(x) = • COS X, 

1 + sin 2 (sin x) 

h'{x) = cos ( [* - ~~ i dt) • ■ - • 
Via 1 + sin 2 f / 1 + sin 2 * 

The formidable appearing function 

fUal +sin't d< ) 1 

/W i a 1 + sin 2 * 

is also a composition ; in fact, / = F ° F. Therefore 

/'« = F'(F(*)) • F'M 

1 1 



sin 2 x 



0 1 A 1 + sir 
^0 
a 1 + sin 2 1 ) 

As these examples reveal, the expression occurring above (or below) the 
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integral sign indicates the function which will appear on the right when / is 
written as a composition. As a final example, consider the triple compositions 

j" (/a i +\imt dt ) 

r(Ia 1 + sin* t dt ) 1 fl 

/W 



f\J a 1+sin^ J | ft /al + sinM J \ 

= / 1 , . t dt, g(x) = / . . . dt, 

J a 1 + sin 2 / J° 1 + sm 2 t 



which can be written 

f = F o F o C and g = F ° F ° F. 

Omitting the intermediate steps (which you may supply, if you still feel 
insecure), we obtain 

f( x ) = 1 1 3 * 2 ,' 

\Ja 1 + sin 2 1 ) 
1 1 

g'W = 



1 + sm 2 / : A Via 1 + sin 2 * / 

Ua 1 + sin 2 1 J 



1 



1 + sin 2 # 



Like the simpler differentiations of Chapter 10, these manipulations should 
become much easier after the practice provided by some of the problems, and, 
like the problems of Chapter 10, these differentiations are simply a test of your 
understanding of the Chain Rule, in the somewhat unfamiliar context pro- 
vided by the Fundamental Theorem of Calculus. 

The powerful uses to which the integral will be put in the following chapters 
all depend on the Fundamental Theorem of Calculus, yet the proof of that 
theorem was quite easy — it seems that all the real work went into the definition 
of the integral. Actually, this is not quite true. In order to apply Theorem 1 to 
a continuous function we need the one theorem whose proof has not yet been 
given: If /is continuous on [a, b\ then /is integrable on [a, b\ The proof which 
will be given depends upon a trick which is not very illuminating, but which 
at least serves to fill this gap in our knowledge. 

If / is any bounded function on [a> b], then 

sup{L(/,P)} and inf { U(f, P) } 

will both exist, even if / is not integrable. These numbers are called the lower 
integral of /on [a, b] and the upper integral of /on [a, b], respectively, and 
will be denoted by 

L/;/ and u/>. 



The lower and upper integrals both have several properties which the integral 
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possesses. In particular, if a < c < b, then 

l /:/= l /:/+ l /> u /:/= u /:/+ u /> 

and if m < fix) < M for all x in [a, b], then 

m{b - a) < L £/ < U £/ < M(Z> - a). 

The proofs of these facts are left as an exercise, since they are quite similar to 
the corresponding proofs for integrals. The results for integrals are actually a 
corollary of the results for upper and lower integrals, because / is integrable 
precisely when 

We will prove that a continuous function / is integrable by showing that this 
equality always holds for continuous functions. It is actually easier to show 
that 

for all x in [a, b]; the trick is to note that most of the proof of Theorem 1 didn't 
even depend on the fact that / was integrable ! 

THEOREM 13-3 If / is continuous on [a, b\ then / is integrable on [a, b\ 

PROOF Define functions L and U on [a, b] by 

LOO = L J*f and U(x) = U j* f. 

Let x be in (a, b). If h > 0 and 

m h = inf {/(*): x < t < x + h}> 
M h = sup {/(*): x < t < x + h), 

then 

m h -h < L J x x+h f < U < M k • h, 

so 

m h • h < L(x + h) - L(x) < U(x + h) — U(x) < M h 'h 

or 

772 a < ; < : < M h- 

h h 

lih<0 and 



m h = inf {/(f): * + h < t < *}, 
M h = sup {/(*): x + h < t < x\, 

one obtains the same inequality, precisely as in the proof of Theorem 1 . 
Since / is continuous at x } we have 

lim m h = lim M h — /(#), 

A— 0 A->0 
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and this proves that 

L'(x) = U'(x) - fix) for x in {a, b). 
This means that there is a number c such that 

U(x) = L(x) + c for all x in 6]. 

Since 

U(a) = = 0, 
the number c must equal 0, so 

U(x) = L(x) for all x in [a, b]. 

In particular, 

U/ U V= 1Kb) = L{b) = L./ a V, 
and this means that / is integrable on [a, b]. | 

PROBLEMS 

1. Find the derivatives of each of the following functions 
(i) F(x) = J* sin 3 1 dt. 

1 

1 + shT 6 1 + t 2 

(iii) F(*) - [*( f* 1 dt) dy. 

J 15 \Js 1 + t 2 + sin 2 / / 7 

dv) fw = r 1 . & 

J* 1 + r + sm 2 £ 

Ja 1 + r + sm 2 / 

(vi) F(x) = sm (^J sm s * n3 1 ^ 

(vii) F l , where F(x) — / - of/. 
Ji t 



(ii) F(*) = ^ — , 



1 

(viii) F 1 where F(x) = / , — - 
Jo VI - 



A. 

Vl - t 2 



(Find (F' 1 )'^) in terms of 
F-'(x).) 



2. For each of the following /, if F(x) = J* f, at which points x is F'(x) = 
/(*)? (Caution: it might happen that F'(x) = /(*), even if / is not 
continuous at 

(i) fix) = 0 if * < 1, /(*) = 1 if x > 1. 

(ii) /(*) = o if * < 1, /(*) = 1 if x > 1. 

(iii) f{x) = 0 if a: * 1, /(*) = 1 if * = 1. 
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FIGURE 6 

(iv) /(*) = 0 if a- is irrational, /(*) = \/q if x = p/q in lowest terms. 

( v ) fa) = 0 if x < 0, /(*) = * if a: > 0. 

(vi) f(x) = 0 if a < 0, /(*) = 1/[1 A] if * > 0. 

(vii) / is the function shown in Figure 6. 

(viii) f(x) = 1 if x = 1 /n for some n in N, /(a) = 0 otherwise. 

3. Find (f i y(0) if 

(i) /(a) = J* 1 + sin (sin 0 

(ii) /(*) = ^ sin (sin 0 a?/. 

(Don't try to evaluate / explicitly.) 

4. Find F'(*) if F(*) = f*xf(t) dt. (The answer is mrt */(*); you should 
perform an obvious manipulation on the integral before trying to find F f .) 

5. Prove that if / is continuous, then 

j 0 x Ku)(x-u)du = /; (/; /(o *) du. 

Hint: Differentiate both sides, making use of Problem 4. 
**6. Use Problem 5 to prove that 

j o x f(u)( X - uYdu = 2 /;(/; 2 (f /(o ^)^)^ 2 

7. Find a function / such that /'"(*) = 1/Vl + sin 2 x. (This problem is 

supposed to be easy; don't misinterpret the word "find.") 
*8. A function / is periodic, with period a, if }{x + a) = /(*) for all x. 

(a) If / is periodic with period a and integrable on [0, a], show that 
/o°/ = -// + 7 ^ all *. 
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(b) Find a function /such that /is not periodic, but /' is. Hint: Choose a 
periodic g for which it can be guaranteed that f(x) = J* g is not 
periodic. 

(c) Suppose that /' is periodic with period a. Prove that / is periodic 
if and only if f{a) = /(0). 

9. Find J* Vxdx, by simply guessing a function / with /'(*) = V**, and 

using the Second Fundamental Theorem of Calculus. Then check with 
Problem 13-16. 



10. Use the Fundamental Theorem of Calculus and Problem 13-16 to 
derive the result stated in Problem 12-15. 

11. (a) Find the derivatives of F(x) = J* 1/t dt and G(x) = j** 1/t dt. 
(b) Now give a new proof for Problem 13-12. 

12. Use the Fundamental Theorem of Calculus and Darboux's Theorem 
(Problem 11-39) to give another proof of the Intermediate Value 
Theorem. 

13. Prove that if h is continuous, / and g are differentiable, and 



m = /;;? hit) dt, 



then F'(x) = h(g(x)) - g'(x) - h(f(x)) • f(x). Hint: Try to reduce this 
to the two cases you can already handle, with a constant either as the 
lower or the upper limit of integration. 
*14. (a) Suppose G' = g and F' = /. Prove that if the function y satisfies the 
differential equation 

(*) g(y(*)) */W = /(*) for all x in some interval, 

then there is a number c such that 

(**) G(y(x)) = F{x) + c for all x in this interval. 

(b) Show, conversely, that ii y satisfies (**), then y is a solution of (*). 

(c) Find what condition y must satisfy if 

>(\ 1 + * 2 

y w = 



l+y(x) 

(In this case g(t) = 1 + t and /(/) = 1 + t 2 .) Then "solve" the 
resulting equations to find all possible solutions y (no solution will 
have R as its domain), 
(d) Find what condition y must satisfy if 

/(*) = — 

1 + S[y(x)Y 

(An appeal to Problem 12-10 will show that there are functions 
satisfying the resulting equation.) 
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(e) Find all functions y satisfying 

y(x)y'(x) = -x. 
Find the solution^ satisfying y(0) = — 1. 

*15. The limit lim / /, if it exists, is denoted by / / (or / /(*) dx), and 

-/° Ja Ja 

called an "improper integral." 

(a) Determine f x r dx> if r < — 1 . 

(b) Use Problem 13-12 to show that 1/x dx does not exist. Hint: 
What can you say about / 1/x dx ? 

(c) Suppose that /(*) > 0 for x > 0 and that J o " / exists. Prove that if 
0 < g(x) < fix) for all x > 0, then J J g also exists. 

(d) Explain why J* 1/(1 + x 2 ) dx exists. Hint: Split this integral up at 1 . 

*16. The improper integral j"^ /is denned in the obvious way, as ^lim f. 
But another kind of improper integral J"^ f is denned in a nonobvious 
way: it is jj f + J_ aa f, provided these improper integrals both exist. 

(a) Explain why J"^ 1/(1 + x 2 ) dx exists. 

(b) Explain why jf^ x dx does not exist. (But notice that lim j N xdx 
does exist.) 

(c) Prove that iff" /exists, then lim [* f exists and equals f" m f. 

Show moreover, that lim f*** 1 f and lim [ f both exist and 

equal J"^ /. Can you state a reasonable generalization of these 
facts? (If you can't, you will have a miserable time trying to do these 
special cases!) 

*17. There is another kind of ' 'improper integral" in which the interval is 
bounded, but the function is unbounded: 

(a) If a > 0, find lim [ a 1 /Vxdx. This limit is denoted by P 1/Vxdx 9 

even though the function fix) = 1/V* is not bounded on [0, a], no 
matter how we define /(0). 

(b) Find ^ Ar r ^ if — 1 < r < 0. 

(c) Use Problem 13-12 to show that J* x~ l dx does not make sense, even 
as a limit. 

(d) Invent a reasonable definition of j a \x\ r dx for a < 0 and compute it 
for -1 < r < 0. 
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(e) Invent a reasonable definition of (1 — x 2 ) 1/2 dx, as a sum 
of two limits, and show that the limits exists. Hint: Why does 
j i (1 + x)~ 112 dx exist? How does (1 + x)~ 112 compare with 
(1 - X 2 )' 112 for -1 < x < 0? 

It is possible, finally, to combine the two possible extensions of the notion 
of the integral. 

(a) If /(*) = \/Vx for 0 < x < 1 and f(x) = \/x 2 for x > 1, find 
JJ f(x) dx (after deciding what this should mean). 

(b) Show that J J x T dx never makes sense. (Distinguish the cases 
— 1 < r < 0 and r < — 1 . In one case things go wrong at 0, in the 
other case at qo ; for r = — 1 things go wrong at both places.) 



CHAPTER 




THE TRIGONOMETRIC FUNCTIONS 



The definitions of the functions sin and cos are considerably more subtle than 
one might suspect. For this reason, this chapter begins with some informal and 
intuitive definitions, which should not be scrutinized too carefully, as they 
shall soon be replaced by the formal definitions which we really intend to use. 

In elementary geometry an angle is simply the union of two half-lines with 
a common initial point (Figure 1). 




figure 1 



More useful for trigonometry are "directed angles," which may be regarded 
as pairs (/i, / 2 ) of half-lines with the same initial point, visualized as in Figure 2. 



ti 




FIGURE 2 



If for h we always choose the positive half of the horizontal axis, a directed 
angle is described completely by the second half-line (Figure 3). 

Since each half-line intersects the unit circle precisely once, a directed angle 
is described, even more simply, by a point on the unit circle (Figure 4), that is, 
by a point (x, y) with x 2 + y 2 = 1 . 
256 
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The sine and cosine of a directed angle can now be defined as follows 
(Figure 5) : a directed angle is determined by a point (*, y) with x 2 + y 2 = 1 ; 
the sine of the angle is defined as y, and the cosine as x. 

Despite the aura of precision surrounding the previous paragraph, we are 
not yet finished with the definitions of sin and cos. Indeed, we have barely 
begun. What we have defined is the sine and cosine of a directed angle; what 
we want to define is sin x and cos x for each number x. The usual procedure for 
doing this depends on associating an angle to every number. The oldest 
method is to "measure angles in degrees." An angle "all the way around" is 
associated to 360, an angle "half-way around" is associated to 180, an angle 
"a quarter way around" to 90, etc. (Figure 6). The angle associated, in this 
manner, to the number x, is called "the angle of x degrees." The angle of 
0 degrees is the same as the angle of 360 degrees, and this ambiguity is pur- 
posely extended further, so that an angle of 90 degrees is also an angle of 
360 + 90 degrees, etc. One can now define a function, which we will denote 
by sin°, as follows: 

sm°(#) = sine of the angle of x degrees. 

There are two difficulties with this approach. Although it may be clear 
what we mean by an angle of 90 or 45 degrees, it is not quite clear what an 
angle of V2 degrees is, for example. Even if this difficulty could be circum- 
vented, it is unlikely that this system, depending as it does on the arbitrary 
choice of 360, will lead to elegant results — it would be sheer luck if the func- 
tion sin 0 had mathematically pleasing properties. 

"Radian measure" appears to offer a remedy for both these defects. Given 
any number x, choose a point P on the unit circle such that x is the length of 
the arc of the circle beginning at (1, 0) and running counterclockwise to P 
(Figure 7). The directed angle determined by P is called "the angle of x 
radians." Since the length of the whole circle is 2tt, the angle of x radians and 
the angle of 2ir + x radians are identical. A function sin r can now be defined 
as follows: 

sin r (Ar) = sine of the angle of x radians. 
This same method can easily be adopted to define sin°; since we want to 
have sin° 360 = sin r 2w, we can define 

. , 2irx . ttx 

sin x = sin r — — = sin r — — • 
360 180 

We shall soon drop the superscript r in sin r , since sin r (and not sin°) is the 
only function which will interest us; before we do, a few words of warning are 
advisable. 

The expressions sin° x and sin r x are sometimes written 

sin x° 
sin x radians, 

but this notation is quite misleading; a number x is simply a number — it does 
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FIGURE 9 



not carry a banner indicating that it is "in degrees" or "in radians." If the 
meaning of the notation "sin x" is in doubt one usually asks: 

"Is x in degrees or radians?" 

but what one means is: 

"Do you mean £ sin°' or 'sin r '?" 

Even for mathematicians, addicted to precision, these remarks might be 
dispensable, were it not for the fact that failure to take them into account will 
lead to incorrect answers to certain problems (an example is given in Problem 
18). 

Although the function sin r is the function which we wish to denote simply 
by sin (and use exclusively henceforth), there is a difficulty involved even in 
the definition of sin r . Our proposed definition depends on the concept of 
length of a curve. Although we could digress, and define length, at the present 
time it is much easier to reformulate the definition in terms of areas, which we 
can treat by means of the integral. (A treatment in terms of length is outlined 
in Problems 32 to 34.) 

Suppose that x is the length of the arc of the unit circle from (1 , 0) to P; this 
arc thus contains x/2tt of the total length 2w of the circumference of the unit 
circle. Let S denote the "sector" shown in Figure 8; S is bounded by the unit 
circle, the horizontal axis, and the half-line through (0, 0) and P. The area of 
S should be x/2t times the area inside the unit circle, which we expect to be t; 
thus S should have area 

x x 

• 7T = — * 

2tt 2 

We can therefore define cos x and sin x as the coordinates of the point P which 
determines a sector of area x/2. 

With these remarks as background, the rigorous definition of the functions 
sin and cos now begins. The first definition identifies it as the area of the unit 
circle — more precisely, as twice the area of a semicircle (Figure 9). 



w = 2 • jl % Vl - x 2 dx. 



(This definition is not offered simply as an embellishment; to define the 
trigonometric functions it will be necessary to first define sin x and cos x only 
for 0 < x < tt.) 

The second definition is meant to describe, for —1 < x < 1, the area A(x) 
of the sector bounded by the unit circle, the horizontal axis, and the half-line 
through (x, y/l — x 2 ). If 0 < x < 1, this area can be expressed (Figure 10) as 
the sum of the area of a triangle and the area of a region under the unit circle : 
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FIGURE 12 
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This same formula happens to work for - 1 < x < 0 also. In this case (Figure 
11), the term 

x Vl - x 2 



is negative, and represents the area of the triangle which must be subtracted 
from the term 

Vl - t 2 dt. 




Notice that if — 1 < x < 1, then A is differentiate at x and (using the 
Fundamental Theorem of Calculus), 



A'(x) = - 
2 

_ 1 

" 2 



-2x 



2Vl 
-x 2 + (1 - X 2 ) 
V\ - X 2 
1 - 2x 2 



+ vT 



- Vi - X 2 



- Vi - x 2 



2 Vl - X 2 
1 - 2x 2 - 2(1 - x 2 ) 
2 Vl — x 2 
-1 



2 Vl - x 2 

Notice also (Figure 12) that on the interval [-1, 1] the function A decreases 
from 

7T 



a{-\) = 0 + f 1 ^ VT^ 



t 2 dt 



to A{\) = 0. This follows directly from the definition of A, and also from the 
fact that its derivative is negative on ( — 1, 1). 

For 0 < x < ir we wish to define cos x and sin x as the coordinates of a point 
P = (cos x, sin x) on the unit circle which determines a sector whose area is 
x/2 (Figure 13). In other words: 



If 0 < x < 7r, then cos x is the unique number in [ — 1, 1] such that 



and 



A (cos x) — -; 



sin x = Vl — (cos x) 2 . 
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This definition actually requires a few words of justification. In order to 
know that there ij a number^ satisfying A(y) = x/2, we use the fact that A is 
continuous, and that A takes on the values 0 and w/2. This tacit appeal to the 
Intermediate Value Theorem is crucial, if we want to make our preliminary 
definition precise. Having made, and justified, our definition, we can now 
proceed quite rapidly. 



THEOREM 1 If 0 < x < 7T, then 



P ~ (cos x, sin x) 




FIGURE 13 



cos'(*) = — sin x, 
sin'(*) = cos x. 



PROOF If B — 2A, then the definition A (cos x) — x/2 can be written 

B (cos x) = x; 

in other words, cos is just the inverse of B. We have already computed that 

1 



A'(x) = - 

from which we conclude that 

B\x) = - 



2 Vt - x 2 



Consequently, 



cos'M = (B-yix) 

1 



B'{B-\x)) 
1 



1 



Since 

we also obtain 



= - V 1 - (cos x) 2 
= — sin x. 

sin x = Vl — (cos #) 2 , 

. / / \ 1 —2 cos x • cos f (x) 

sin (x) = - • . =^ 

2 Vl - (cos x) 2 

_ cos x sin x 

sin x 

= cos ^. I 



The information contained in Theorem 1 can be used to sketch the graphs 
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of sin and cos on the interval [0, ir]. Since 

cos'(x) = — sin x < 0, 0 < x < x, 

the function cos decreases from cos 0 = 1 to cos t = — 1 (Figure 14). Conse- 
quently, cos y = 0 for a unique y in [0, w]. To find y, we note that the definition 
of cos, 

A (cos x) = -> 
2 



means that 

SO 

y = 2 £ Vl ~ t 2 dt. 

It is easy to see that 

Vi - t* dt = j* Vi - ? dt, 

so we can also write 



Now we have 



sin'W = cos ^ ' 

I < 0, 7T/2 < X < 7T, 



so sin increases on [0, ir/2] from sin 0 = 0 to sin w/2 = 1, and then decreases 
on [t/2, 7t] to sin 7r = 0 (Figure 15). 

The values of sin x and cos x for x not in [0, t] are most easily defined by a 
two-step piecing together process: 

(1) If 7T < x < 2tt, then 

sin a* — — sin(27r — x), 
COS X = cos(27r — x). 

Figure 16 shows the graphs of sin and cos on [0, 2ir]. 

(2) If x = 2irk + x' for some integer k } and some x f in [0, 2w], then 

sin x = sin x\ 
cos = cos x\ 

Figure 17 shows the graphs of sin and cos, now defined on all of R. 

Having extended the functions sin and cos to R, we must now check that 
the basic properties of these functions continue to hold. In most cases this is 
easy. For example, it is clear that the equation 

sin 2 x + cos 2 x — 1 
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(a) 




FIGURE 17 

holds for all x. It is also not hard to prove that 

sin' (a:) = cos x, 
cos' (a:) = — sin x, 

if x is not a multiple of 7r. For example, if ir < x < 2ir, then 

sin x = — sin(27r — x), 

so 

sin'O) = - sin'(27r - x) • (-1) 

— C0S(27T — x) 
= COS X. 

If x is a multiple of t we resort to a trick; it is only necessary to apply 
Theorem 11-7 to conclude that the same formulas are true in this case also. 
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The other standard trigonometric functions present no difficulty at all. We 
define 

sec x 
tan x 
esc x 
cot x 

The graphs are sketched in Figure 18. It is a good idea to convince yourself 
that the general features of these graphs can be predicted from the derivatives 
of these functions, which are listed in the next theorem (there is no need to 
memorize the statement of the theorem, since the results can be rederived 
whenever needed.) 

THEOREM 2 If x ?± kir + 7r/2, then 

sec'(#) = sec x tan x, 
tan' (^) = sec 2 x. 

If x ^ kir, then 

csc'(Y) = — esc x cot x, 
cot'(Y) = — esc 2 x, 

PROOF Left to you (a straightforward computation). | 

The inverses of the trigonometric functions are also easily differentiated. 
The trigonometric functions are not one-one, so it is first necessary to restrict 
them to suitable intervals; the largest possible length obtainable is t, and the 
intervals usually chosen are (Figure 19) 

[-tt/2, tt/2] for sin, 
[0, 7r] for cos, 

(-tt/2, tt/2) for tan. 

(The inverses of the other trigonometric functions are so rarely used that they 
will not even be discussed here.) 
The inverse of the function 

f{x) = sin x, —tt/2 < x < ir/2 

is denoted by arcsin (Figure 20); the domain of arcsin is [ — 1, 1]. The 
notation sin -1 has been avoided because arcsin is not the inverse of sin 
(which is not one-one), but of the restricted function /; the notation sin -1 has 
the additional disadvantage that sin _1 (*) might be construed as 1/sin x. 
The inverse of the function 



cos x 
sin x 
cos x 
1 

sin x 
cos x 



x t± kw + tt/2, 



X 9* k-K. 



g(x) — COS X, 0 < X < 7T 
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is denoted by arccos (Figure 21); the domain of arccos is [ — 1, 11. 
The inverse of the function 

h(x) = tan x, —w/2 < x < t/2 

is denoted by arctan (Figure 22) ; arctan is one of the simplest examples of a 
differentiable function which is bounded even though it is one-one on all of R. 

The derivatives of the inverse trigonometric functions are surprisingly sim- 
ple, and do not involve trigonometric functions at all. Finding the derivatives 
is a simple matter, but to express them in a suitable form we will have to sim- 
plify expressions like 

cos(arcsin x), 
sec (arctan x). 




FIGURE 22 




FIGURE 23 



PROOF 



A little picture is the best way to remember the correct simplifications. For 
example, Figure 23 shows a directed angle whose sine is x — the angle shown is 
thus an angle of (arcsin x) radians; consequently cos(arcsin x) is the length of 
the other side, namely, x 2 . However, in the proof of the next theorem 

we will not resort to such pictures. 



theorem 3 If -1 < x < 1, then 



arcsin '(x) — 



arccos f (x) 
Moreover, for all x we have 

arctan' (x) 

arcsin '(#) 



1 



Vi - x 2 

l 

1 + x* 

i 

i 

sin' (arcsin x) 
1 

cos (arcsin x) 
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Now 

[sin(arcsin x)] 2 + [cos(arcsin x)] 2 = 1, 

that is, 

x 2 + [cos(arcsin x)] 2 = 1; 

therefore, 

cos(arcsin x) = Vl — x 2 . 

(The positive square root is to be taken because arcsin x is in (— 7r/2, ir/2), so 
cos(arcsin x) > 0.) This proves the first formula. 

The second formula has already been established (in the proof of 
Theorem 1). It is also possible to imitate the proof for the first formula, a 
valuable exercise if that proof presented any difficulties. The third formula 
is proved as follows. 

arctan'M = (/T 1 )'^) 

_J 

" h'(h~ l {x)) 
_ 1 

tan '(arc tan x) 

- 1 

sec 2 (arctan x) 

Dividing both sides of the identity 

sin 2 a + cos 2 a = 1 

by cos 2 a yields 

tan 2 a + 1 = sec 2 a. 

It follows that 

[tan (arc tan x)] 2 + 1 = sec 2 (arc tan x), 

or 

x 2 + 1 = sec 2 (arctan 
which proves the third formula. | 

The traditional proof of the formula sin'(Ar) = cos x (quite different from 
the one given here) is outlined in Problem 26. This proof depends upon first 
establishing the limit 

sin h 
hm— — = 1, 
h->o h 

and the "addition formula" 

sin(# + y) = sin x cos y + cos x sin y. 

Both of these formulas can be derived easily now that the derivative of sin and 
cos are known. The first is just the special case sin'(O) = cos 0. The second 
depends on a beautiful characterization of the functions sin and cos. In order 
to derive this result we need a lemma whose proof involves a clever trick; a 
more straightforward proof will be supplied in Part IV. 
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LEMMA Suppose / has a second derivative everywhere and that 

f"+f=0, 
AO) = 0, 

AO) = o. 

Then / = 0. 

PROOF Multiplying both sides of the first equation by /' yields 

/'/"+//' = 0. 

Thus 

[(f) 2 +f 2 ]' = 2(/'/" + //') = 0, 

so (/')' +/ 2 is a constant function. From /(0) = 0 and /'(0) = 0 it follows 
that the constant is 0; thus 

[/'MP + [/MP = 0 for all 

This implies that 

/M = 0 for all *. | 
THEOREM 4 If / has a second derivative everywhere and 

r+f-o, 

/(0) = a, 
/'(0) = A, 

then 

/ = b ' sin + a ■ cos. 

(In particular, if /(0) = 0 and /'(0) = 1, then / = sin; if /(0) = 1 and 
/'(0) = 0, then / = cos.) 

proof Let 

g( x ) ~ /M b sin x — a cos x. 

Then 

£'M = /'M — 6 cos * + a sin a:, 
£"M = /"(*) + * sin * + a cos *. 

Consequently, 





= o, 


g(0) 


= o, 


g'(0) 


= o, 



which shows that 

0 = g(x) = f(x) — b sin x — a cos at, for all #. | 

THEOREM 5 If * and y are any two numbers, then 

sin(# + y) — sin x cos j> + cos x sin >>, 
cos(* + y) = cos a- cos ^ — sin # sin jy. 
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PROOF For any particular number y we can define a function / by 

/(*) = sin(x +y). 

Then 

f(x) = cos(* + y), 
/"(*) = - sinO +y). 

Consequently, 

r +/ = o, 

/(0) = sin y, 
/'(0) = cos y. 

It follows from Theorem 4 that 

/ = (cos y) - sin + (sin y) • cos; 

that is, 

sin (a: + y) = cos sin x + sin j cos for all 

Since any number^ could have been chosen to begin with, this proves the first 
formula for all x and y. 

The second formula is proved similarly. | 

As a conclusion to this chapter, and as a prelude to Chapter 17, we will 
mention an alternative approach to the definition of the function sin. Since 

arcsin'C*) = f 1 for — 1 < * < 1, 

Vl - x 2 

it follows from the Second Fundamental Theorem of Calculus that 

arcsin x = arcsin x — arcsin 0 = / , - dt. 

Jo VI - t 2 

This equation could have been taken as the definition of arcsin. It would follow 
immediately that 

arcsin (x) = . 

VI- t 2 

the function sin could then be defined as (arcsin) -1 and the formula for the 
derivative of an inverse function would show that 



sin^*) = Vl — sin 2 x, 

which could be defined as cos x. Eventually, one could show that ,4 (cos x) = 
x/2, recovering at the very end of the development the definition with which 
we started. While much of this presentation would proceed more rapidly, the 
definition would be utterly unmotivated; the reasonableness of the definitions 
would be known to the author, but not to the student, for whom it was 
intended! Nevertheless, as we shall see in Chapter 17, an approach of this sort 
is sometimes very reasonable indeed. 



PROBLEMS 



Differentiate each of the following functions. 

(0 /(*) = arctan(arctan(arctan x)). 
(ii) f{x) = arcsin (arctan (arccos x)). 
(in) f(x) = arctan (tan x arctan x). 

(iv) f(x) = arcsin ( 1 Y 
Wl + W 

Find the following limits by PHopitaPs Rule, 
(i) lim 
(ii) lim 



sin x 


- x + * 3 /6 






sin x 


- * + * 3 /6 






cos a: 


- 1 + x 2 /2 




X 2 


cos a* 


- 1 + x 2 /2 



(hi) lim 



(iv) lim 

arctan x — a: + a: 3 /3 



(v) lim 



(vi) lim (1 - J-Y 
*-»o V* sin x/ 

I sin at 
— , x*0 
1, a: = 0. 

(a) Find /'(0). 

(b) Find /"(0). 

At this point, you will almost certainly have to use PHopitaPs Rule, but 
in Chapter 23 we will be able to find / (fc) (0) for all k, with almost no work 
at all. 



4. Graph the following functions. 

(a) f(x) = sin 2x. 

(b) f(x) = sin(* 2 ). (A pretty respectable sketch of this graph can be 
obtained using only a picture of the graph of sin. Indeed, pure 
thought is your only hope in this problem, because determining the 
sign of the derivative f'(x) = cos(x 2 ) • 2x is no easier than deter- 
mining the behavior of /directly. The formula for f'(x) does indicate 
one important fact, however — /'(0) = 0, which must be true since / 
is even, and which should be clear in your graph.) 

(c) f(x) = sin x + sin 2*. (It will probably be instructive to first draw 
the graphs of g(x) = sin x and h(x) = sin 2a: carefully on the same 
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set of axes, from 0 to 2w, and guess what the sum will look like. You 
can easily find out how many critical points / has on [0, 2ir] by con- 
sidering the derivative of/. You can then determine the nature of 
these critical points by finding out the sign of / at each point; your 
sketch will probably suggest the answer.) 

(d) f(x) = tan x — x. (First determine the behavior of /in (— tt/2, tt/2); 
in the intervals (kw — tt/2, kir + 7r/2) the graph of / will look 
exactly the same, except moved up a certain amount. Why?) 

(e) f{x) = sin x — x. (The material in the Appendix to Chapter 11 will 
be particularly helpful for this function.) 

I sin x 
1, x = 0. 

(Part (d) should enable you to determine approximately where the 
zeros of /' are located. Notice that / is even and continuous at 0; also 
consider the size of / for large x.) 

5. Prove the addition formula for cos. 

6. (a) From the addition formula for sin and cos derive formulas for sin 2x, 

cos 2x, sin 3x, and cos 3*. 
(b) Use these formulas to find the following values of the trigonometric 
functions (usually deduced by geometric arguments in elementary 
trigonometry) : 

2 ' 



. 7T 

sm - 
4 


7T 

= cos - 
4 


7T 

tan - 
4 


= 1, 


sin - 
6 


_ 1 

2 


7T 

cos - 
6 


2 ' 



7. (a) Show that A sin (a: + B) can be written as a sin x + b cos x for suit- 

able a and b. (One of the theorems in this chapter provides a one-line 
proof. You should also be able to figure out what a and b are.) 

(b) Conversely, given a and b, find numbers A and B such that a sin x 
+ b cos x = A sin(* + B) for all x. 

(c) Use part (b) to graph f{x) = V3 sin x + cos x. 

8. (a) Prove that 

, x tan x + tan v 

tan(* + y) = 

1 — tan x tan y 

provided that x, y, and x + y are not of the form kir + tt/2. (Use the 
addition formulas for sin and cos.) 



Derivatives and Integrals 



(b) Prove that 

arc tan x + arc tan y = arctan ( * ^ Y 

\1 — ry/ 

indicating any necessary restrictions on # andjy. Hint: Replace # by 
arctan # and y by arctan jy in part (a) . 
9. Prove that 

arcsin a + arcsin = arcsin (aV'l — /3 2 + /3 \/l — a 2 ), 

indicating any restrictions on a and /5. 

10. Prove that if m and w are any numbers, then 

sin mx sin nx — ^[cos (m — n)x — cos (m + n)x], 
sin rax cos nx — ^-[sin + n)x + sin (m — n)x], 
cos cos rax = i[cos (m + w)# + cos (m — »)*]. 

11. Prove that if m and n are natural numbers, then 



m n 
m = n, 



f* sin mx sin nx dx — | ^' 

/-* [TT, 

/■* , ( 0, m n 

/ cos mx cos w# = { 3 

•/-*■ ( TT, 772 — n, 

J* sin m# cos = 0. 



These relations are particularly important in the theory of Fourier 
series. Although this topic will receive serious attention only in the Sug- 
gested Reading, the next problem provides a hint as to their importance. 
12. (a) If / is integrable on [ — ir, x], show that the minimum value of 

Jl w (/W " a cos nx ^ 2 ^* 

occurs when 



a = - \* fix) cos nx dx, 
and the minimum value of 



when 



1 r* 

a = - / fix) sin n# 

7T ./ 



(In each case, bring a outside the integral sign, obtaining a quad- 
ratic expression in a,) 
(b) Define 



a n = — f' f{x) cos nx dx, n = 0, 1, 2, 
b n = - [* fix) sin n# i*, « = 1, 2, 3, 
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Show that if Ci and di are any numbers, then 

N 

J - ^ + ^ C n C0S nX + d n Sin fMf </* 

n — 1 

N N 

= /' [/(*)]* dx - 2t ftp + V a B <„ + M.) + * (f + £ <„ 2 + </» 2 ) 

n=l n=l 

AT 

= £ [/(*)]« dx - * + £ a n * + *„ 2 ) 

n = 1 

+ ir ((7-2-^) 2 + t (c "- a " )2+( ^- W2 )' 

n = 1 

thus showing that the first integral is smallest when cn = f< and 
bi = d^ In other words, among all "linear combinations" of the 
functions s n (x) = sin nx and c n (x) - cos nx for 1 < n < N, the 
particular function 

N 

g( x ) = ~ + ^ a n cos nx + b n 



sin nx 



has the "closest fit" to / on [— 7r, 7r]. 

13. Find a formula for sin * + sin y and for cos x + cos > Hint: First find a 
formula for sin {a + b) + sin (a - 6). What good does that do? 

14. (a) Starting from the formula for cos 2x, derive formulas for sin 2 x and 

cos 2 x in terms of cos 2x. 
(b) Prove that 



x 

cos - v 

2^2 



/l + cos * . . x 1 

\ o and Sm O = \ 



for 0 < x < tt/2. 
(c) Use part (a) to find sin 2 x and j a cos 2 x 

15. Find sin(arctan x) and cos(arctan x) as expressions not involving 
trigonometric functions. Hint: y = arctan x means that x = tan ^ = 
sinjy/cosjy = sin^y/v'l — sin 2 }'. 

16. If x = tan u/2, express sin u and cos u in terms of x. (Use Problem 15; 
the answers should be very simple expressions.) 

17. (a) Prove that sin(x + tt/2) = cos x. (All along we have been drawing 

the graphs of sin and cos as if this were the case.) 
(b) What is arcsin(cos x) and arccos(sin x)? 
ri \ 

18. (a) Find / dt. Hint: The answer is not 45. 

W Jo 1 + t 2 
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(b) Find 



Jo 1 + 



dt. 




19. Find lim x sin — 

X—* 00 X 

20. (a) Define functions sin 0 and cos 0 by sin°(» = sin(7r*/180) and 

cos°(*) = cos(7r*/180). Find (sin 0 )' and (cos°)' in terms of these 
same functions. 

(b) Find lim Sm - and lim x sin° -• 

x-+0 X x->*> x 

21. Prove that every point on the unit circle is of the form (cos 0, sin 6) for 
at least one (and hence for infinitely many) numbers 6. 

22. (a) Prove that w is the maximum possible length of an interval on which 

sin is one-one, and that such an interval must be of the form 
(2kir - t/2, 2kw + tt/2). 
(b) Suppose we let g(x) = sin x for x in (2/for — t/2, 2kir + tt/2). What 

is or 1 )'? 

23. Let f(x) = sec x for 0 < x < t. Find the domain of / _1 and sketch its 
graph. 

24. Prove that |sin x — sin jy| < |^ — for all numbers x and y. Hint: The 
same statement, with < replaced by < , is a very straightforward conse- 
quence of a well-known theorem; simple supplementary considerations 
then allow < to be improved to <. 

'25. It is an excellent test of intuition to predict the value of 



lim />) 



X* dx. 



0 B = (1, 0) 

FIGURE 24 



Continuous functions should be most accessible to intuition, but once 
you get the right idea for a proof the limit can easily be established for 
any integrable /. 

(a) Show that lim ( d sin \x dx = 0, by computing the integral 
explicitly. 

(b) Show that if s is a step function on [a, b] (terminology from Problem 
13-17), then lim [ b s(x) sin \x dx = 0. 

\_>oo J a 

(c) Finally, use Problem 13-17 to show that lim f b f(x) sin \x dx = 0 

X->oo J a 

for any function / which is integrable on [a, b]. 

This result, like Problem 1 1 , plays an important role in the theory of 
Fourier series; it is known as the Riemann-Lebesgue Lemma. 

26. This problem outlines the classical approach to the trigonometric func- 
tions. The shaded sector in Figure 24 has area x/2. 
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(a) By considering the triangles OAB and OCB prove that if 0 < x < 
7r/4, then 

sin xx sin x 

< < 

2 2 2 cos * 

(b) Conclude that 

sin x 

cos x < < 1, 

x 

and prove that 

sin x 
hm = 1 . 

x->0 X 

(c) Use this limit to find 

1 — cos x 
hm 

x->0 x 

(d) Using parts (b) and (c), and the addition formula for sin, find 
sin'(Y), starting from the definition of the derivative. 

*27. Yet another development of the trigonometric functions was briefly 
mentioned in the text — starting with inverse functions defined by inte- 
grals. It is convenient to begin with arctan, since this function is defined 
for all x. To do this problem, pretend that you have never heard of the 
trigonometric functions. 

(a) Let a{x) = f* (1 + t 2 )" 1 dt. Prove that a is odd and increasing, 
and that lim a(x) and lim a{x) both exist, and are negatives of 

X — ► oo X — ► » ~ 

each other. If we define 7r = 2 lim a(x) } then aT 1 is defined on 

(-x/2,t/2). 

(b) Show that (cO'M = 1 + [<x~ l (x)]*. 

(c) For x = kir + x' with x' ^ 7r/2 or — 7r/2, define tan x = aT^*')- 
Then define cos x = 1 /VI + tan 2 x, for x not of the form kir + x/2 
or kir 7r/2, and cos {kir ± tt/2) = 0. Prove first that cos'(^) = 
— tan x cos x, and then that cos"(.x:) = — cos x for all x. 

*28. If we are willing to assume that certain differential equations have solu- 
tions, another approach to the trigonometric functions is possible. Sup- 
pose, in particular, that there is some function y 0 which is not always 0 
and which satisfies yo" + y 0 = 0. 

(a) Prove thatjy 0 2 + (joO 2 is constant, and conclude that either ;> 0 (0) ^ 0 
ory(O) ^ 0. 

(b) Prove that there is a function s satisfying s" + s — 0 and s(0) = 0 
and /(O) = 1. Hint: Try s of the form ay 0 + byo'. 
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If we define sin = s and cos = /, then almost all facts about 
trigonometric functions become trivial. There is one point which 
requires work, however — producing the number 7r. This is most 
easily done using an exercise from the Appendix to Chapter 1 1 : 

(c) Use Problem 6 of the Appendix to Chapter 1 1 to prove that cos x 
cannot be positive for all x > 0. It follows that there is a smallest 
#o > 0 with cos # 0 = 0, and we can define t = 2x 0 . 

(d) Prove that sin ir/2 = 1. (Since sin 2 + cos 2 = 1, we have sin x/2 = 
±1; the problem is to decide why sin 7r/2 is positive.) 

(e) Find cos 7r, sin w, cos 27r, and sin 2ir. (Naturally you may use any 
addition formulas, since these can be derived once we know that 
sin' = cos and cos' = — sin.) 

(f) Prove that cos and sin are periodic with period 2ir. 

29. (a) After all the work involved in the definition of sin, it would be dis- 
concerting to find that sin is actually a rational function. Prove that 
it isn't. (There is a simple property of sin which a rational function 
cannot possible have.) 
(b) Prove that sin isn't even defined implicitly by an algebraic equation; 
that is, there do not exist rational functions / 0 , . . . , f n -i such that 

(sin x) n + /„_!(*) (sin x) n ~ l + • • • + /„(*) = 0 for all x. 

Hint: Prove that f 0 = 0, so that sin x can be factored out. The 
remaining factor is 0 except perhaps at multiples of 2ir. But this 
implies that it is 0 for all x. (Why?) You are now set up for a proof 
by induction. 

*30. Suppose that 0i and 0 2 satisfy 

0i" + £i0i = 0, 

and that g 2 > gi. 

(a) Show that 

0l"02 — 02"01 — (g2 — gl)0102 = 0. 

(b) Show that if 0i(#) > 0 and 0 2 (*) > 0 for all x in (a, b), then 

I* [0i ,, 02 - 0 2 "0i] > 0, 
and conclude that 

[0i'W0 2 W - 0i'(a)0 2 (< 2 )][0 1 (£)0 2 '(£) - 0i(*)0 2 'M] > o. 

(c) Show that in this case we cannot have 0i(#) = 0i(£) = 0. Hint: 
Consider the sign of <f>i(a) and <t>i(b). 

(d) Show that the equations <pi(a) = 0i(£) = 0 are also impossible if 
0i > 0, 0 2 < 0 or 0! < 0, 02 > 0, or 0i < 0, 0 2 < 0 on (a, b). 
(You should be able to do this with almost no extra work.) 
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The net result of this problem may be stated as follows: if a and b are 
consecutive zeros of <f>i, then </> 2 must have a zero somewhere between 
a and b. This result, in a slightly more general form, is known as the 
Sturm Comparison Theorem. As a particular example, any solution 
of the differential equation 

y" + (x + \)y - 0 

must have zeros on the positive horizontal axis which are within w of 
each other. 

31. Prove that if sin x/2 ^ 0, then 

- + cos x + cos 2x + • • • + cos nx 



At this stage of the game, this problem is a mathematical idiot's delight. 
A proof by induction depends on establishing the formula 

sin(n + £)* . ( , sinO + £)* 
— f- cos (« + 1)# = 

2 sin - 2 sin - 

2 2 

This will require repeated use of addition formulas, in just the right 
places, but very little thinking. A more reasonable derivation of the 
formula will occur in Problem 26-13. Like two other results in this prob- 
lem set, this equation is very important in the study of Fourier series, 
and we also make use of it in Problems 18-28 and 22-17. 

The remaining problems in this chapter form a brief introduction to the 
topic of arc length, and show how trigonometric functions can be defined in 
terms of arc length. 

*32. Let /be a continuous function on [a, b\ If P = {^o, . • . ? t n ] is a parti- 
tion of [<z, b], define 

n 
i = l 

The number t(f 9 P) represents the length of a polygonal curve inscribed 
in the graph of / (see Figure 25). We define the length of / on [a, b] to 
be the least upper bound of all t(f, P) for all partitions P (provided that 
the set of all such -l(f, P) is bounded above). 

(a) If / is a linear function on [a, b], prove that the length of / is the dis- 
tance from (a, f(a)) to (b, f(b)). 

(b) If / is not linear, prove that there is a partition P = {a, t 9 b] of 
[a, b] such that /(/, P) is greater than the distance from (a, f(a)) to 
\bj\b)). (You will need Problem 4-8.) 



sin(n + ^)x 



2 sin : 
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1 1 1 : 1 1 

a = t 0 ti t 2 t 3 t 4 = b 

FIGURE 25 

(c) Conclude that of all functions /on [a y b] with f(a) = c and f(b) = d, 
the length of the linear function is less than the length of any other. 
(Or, in conventional but hopelessly muddled terminology: "A 
straight line is the shortest distance between two points. 55 ) 

*33. (a) Suppose that /' is bounded on [a, b]. UP is any partition of [a, b] 
show that 

L(Vi + cm p) < t{L P) < u(Vi + (fy, p). 

Hint: Use the Mean Value Theorem. 

(b) Why is sup {L(Vl + {f)\ p)\ < sup {/(/, P)}? (This is easy.) 

(c) Now show that sup {/(/, P)\ < inf {U( V\ + (f)\ P)\, thereby 
proving that the length off on [a, b] is f* Vl + (f)\ if Vl + (/')« 
is integrable on [a, b]. Hint: It suffices to show that if P f and P" are 
any two partitions, then P r ) < ^7(Vl + (f) 2 , P ;/ ). If P con- 
tains the points of both P' and P", how does /(/, P') compare to 
t{f, P)? 

*34. Let /(at) = Vl - x 2 for -1 < x < 1. Define £(x) to be the length of 
/on [x, 1]. 

(a) Show that 




(This is actually an improper integral, as defined in Problem 14-17.) 

(b) Show that 

£'(*) = r 1 for -1 < * < 1. 

VI - 

(c) Define w as £( — 1). For 0 < x < t, define cos * by «£(cos x) = x, 
and define sin x = Vl — cos 2 x. Prove that cos'W = —sin x and 
sin'(*) = cos x for 0 < x < ir. 
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This short chapter, diverging from the main stream of the book, is included to 
demonstrate that we are already in a position to do some sophisticated mathe- 
matics. This entire chapter is devoted to an elementary proof that ir is irra- 
tional. Like many 4 'elementary' 5 proofs of deep theorems, the motivation for 
many steps in our proof cannot be supplied; nevertheless, it is still quite possi- 
ble to follow the proof step-by-step. 

Two observations must be made before the proof. The first concerns the 
function 

*»(! - xY 

/»(*) = . ' 

nl 

which clearly satisfies 

0< f n (x) < — for 0 < x < 1. 
nl 

An important property of the function f n is revealed by considering the expres- 
sion obtained by actually multiplying out x n {\ — x) n . The lowest power of x 
appearing will be n and the highest power will be 2n. Thus f n can be written 
in the form 

2n 

u{x) = hX CiXi ' 

i = n 

where the numbers a are integers. It is clear from this expression that 
/ n <*>(0) =0 if k < n or k > 2n. 

Moreover, 

fn (n) (x) = — [n! c n + terms involving x] 
nl 

f n (n+1) (x) =—[(« + 1)! c n +i + terms involving x] 
nl 



A (2W) W =~[(2n)\c 2n l 
nl 
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This means that 



/n (n) (0) = C n) 
/n (W+1) (0) - (» + l), n+1 , 



/«< 2n) (0) = (2»)(2« - 1) «...-(« + 1)* 2 «, 
where the numbers on the right are all integers. Thus 
/n (fc) (0) is an integer for all £, 

The relation 

/»(*) = /n(l " *) 

implies that 

A tt) W = (-i)Yn (ft) (i -*); 

therefore, 

/ n (fc) (l) is also an integer for all k. 

The proof that x is irrational requires one further observation: if a is any 
number, and s > 0, then for sufficiently large n we will have 

a n 
n\ 

To prove this, notice that if n > 2a, then 

a n+l a a n 1 a n 

< - • — 



(n + 1)! n + 1 n! 2 r! 
Now let w 0 be any natural number with n 0 > 2a. Then, whatever value 

(no) I 

may have, the succeeding values satisfy 

a (n 0 +l) I a n 0 



(n 0 +1)! 2 (n 0 )! 

fl (no+2) J fl (n.+ i) ! J a n 0 

< - * — TTT < 



(n 0 + 2)! 2 (» 0 + 1)! 2 2 (n 0 )! 



1 a n ° 

< ~7 



(n 0 + k)\ 2* (n 0 ) 
a 110 

If A; is so large that < 2*, then 

(«o)!e 
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a (no+k) 



(n 0 + k)\ 

which is the desired result. Having made these observations, we are ready 
for the one theorem in this chapter. 

THEOREM l The number x is irrational; in fact, x 2 is irrational. (Notice that the irration- 
ality of x 2 implies the irrationality of x, for if 7r were rational, then 7r 2 certainly 
would be.) 

PROOF Suppose x 2 were rational, so that 

2 0 
T 2 = - 

b 

for some positive integers a and b. Let 

(i) g(x) = *"[*•'»/»(*) - T 2n - 2 /«"to + r«»-y w w(*) 

+ (-l)7n (2n) (*)]. 

Notice that each of the factors 



b n TT 2n ~ 2k = b n (TT 2 ) n - k = £ n ^ 



i-Jfe 



is an integer. Since f n (k) (0) and f n {k) (^) are integers, this shows that 

G(0) and G(l) are integers. 
Differentiating G twice yields 

(2) G"(*) - b n [T* n f n "( X ) - T 2n ~ 2 f n ^(x) + • • • + (-l) n /n (2n+2) (*)]. 

The last term, (-l) n / n (2n+2) (*), is zero. Thus, adding (1) and (2) gives 
(3) G"(x) + ir 2 G(x) = b n ir 2n+2 f n {x) = xV/ n (*). 

Now let 

H(x) — G'(x) sin irx — xG(x) cos irx. 

Then 

#'(*) = xG'O) cos x# + G"0) sin irx - xG'O) cos irx + ir 2 G(x) sin xx 
= \G"{x) + x 2 G(*)] sin irx 
= ir 2 a n f n (x) sin xx, by (3). 

By the Second Fundamental Theorem of Calculus, 

x 2 f*a n f n (x)simrxdx = - H(0) 

= G'{\) sinx - xG(l) cosx - G'(0) sin 0 + xG(0) cos 0 
- x[G(l) + G(0)]. 

Thus 

x J Q a n f n (x) sin xx </x is an integer. 



On the other hand, 0 < f n (x) < l/n\ for 0 < x < 1, so 

ita n 

0 < Ta n f n (x) sin irx < for 0 < x < 1. 

nl 

Consequently, 

0 < 7r f a n f n (x) sin wx dx < 

Jo nl 

This reasoning was completely independent of the value of n. Now if n is large 
enough, then 

0 < 7r / a n f n (x) sin irx dx < — - < 1. 
Jo n\ 

But this is absurd, because the integral is an integer, and there is no integer 
between 0 and 1. Thus our original assumption must have been incorrect: 
7r 2 is irrational. | 

This proof is admittedly mysterious; perhaps most mysterious of all is the 
way that 7r enters the proof — it almost looks as if we have proved it irrational 
without ever mentioning a definition of it. A close reexamination of the proof 
will show that precisely one property of x is essential — 

sin(7r) = 0. 

The proof really depends on the properties of the function sin, and proves the 
irrationality of the smallest positive number x with sin x = 0. In fact, very few 
properties of sin are required, namely, 

sin' = cos, 

cos' = — sin, 
sin(0) = 0, 
cos(0) = 1. 

Even this list could be shortened; as far as the proof is concerned, cos might 
just as well be defined as sin'. The properties of sin required in the proof may 
then be written 

sin" + sin = 0, 
sin(0) = 0, 
sin'(0) = 1. 

Of course, this is not really very surprising at all, since, as we have seen in the 
previous chapter, these properties characterize the function sin completely. 

PROBLEMS 

1. (a) Prove that the areas of triangles OAB and OAC in Figure 1 are related 
by the equation 



7r is Irrational 281 



area OAC = - 




1 jl - Vl - 16 (area OAS) 2 



Hint: Solve the equations *y = 2(area OAS), x 2 + / = 1, for y. 

(b) Let P m be the regular polygon of m sides inscribed in the unit circle. 
If A m is the area of P m show that 



This result allows one to obtain (more and more complicated) expres- 
sions for A 2 % starting with A 4 = 2, and thus to compute t as accu- 
rately as desired (according to Problem 8-11). Although better meth- 
ods will appear in Chapter 19, a slight variant of this approach yields 
a very interesting expression for 7r: 

(a) Using the fact that 



show that if a m is the distance from 0 to one side of P m , then 



Ai m 



= ~ V2 - 2 Vl - (2^ m /m) 2 . 



area(0A8) 
area((MC) 



= OB, 




(b) Show that 



2 



A 2 « 



«4 ' OL S ' 



(c) Using the fact that 



a m = cos 



7T 

— : 

m 



and the formula cos x t 



1 + COS X 



(Problem 15-14), prove that 






etc. 



Together with part (b), this shows that 2/tt can be written as an 
"infinite product" 

to be precise, this equation means that the product of the first n fac- 
tors can be made as close to 2/tt as desired, by choosing n sufficiently 
large. This product was discovered by Francois Viete in 1579, and is 
only one of many fascinating expressions for ir, some of which are 
mentioned later. 



CHAPTER 




THE LOGARITHM AND 
EXPONENTIAL FUNCTIONS 



In Chapter 15 the integral provided a rigorous formulation for a preliminary 
definition of the functions sin and cos. In this chapter the integral plays a more 
essential role. For certain functions even a preliminary definition presents 
difficulties. For example, consider the function 

/(*) = 10-. 

This function is assumed to be defined for all x and to have an inverse function, 
defined for positive x, which is the "logarithm to the base 10," 

f l (x) = logio x. 

In algebra, 10* is usually defined only for rational x, while the definition for 
irrational x is quietly ignored. A brief review of the definition for rational x 
will not only explain this omission, but also recall an important principle 
behind the definition of 10 x . 

The symbol 10" is first defined for natural numbers n. This notation turns 
out to be extremely convenient, especially for multiplying very large numbers, 
because 

The extension of the definition of 10 x to rational x is motivated by the desire to 
preserve this equation; this requirement actually forces upon us the customary 
definition. Since we want the equation 

10° • 10 n = 10 0+n = 10 n 
to be true, we must define 10° = 1 ; since we want the equation 

lCT n • 10 n = 10° = 1 
to be true, we must define lO" 71 = l/10 n ; since we want the equation 
10 1/n • . . . • 10 1/n = io 1 / n +"'* +1/n = 10 1 = 10 

n times n times 

to be true, we must define 10 1/n = vT<); and since we want the equation 

io 1/n • . . . • io 1/n = io 1 / n+ "- +1/n = 10 m/n 

m times m t imes 



to be true, we must define 10 mln = (V 10) m . 

Unfortunately, at this point the program comes to a dead halt. We have 
been guided by the principle that 10* should be defined so as to ensure that 
10*+v = 10*10*; but this principle does not suggest any simple algebraic way 
of defining 10* for irrational x. For this reason we will try some more sophisti- 
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cated ways of finding a function / such that 

(*) /(* + y) - /(*) ' /GO for all x and y. 

Of course, we are interested in a function which is not always zero, so we might 
add the condition /(l) ^ 0. If we add the more specific condition /(l) = 10, 
then (*) will imply that /(*) = 10* for rational *, and 10 x could be defined as 
f{x) for other x; in general /(*) will equal [/(l)] x for rational x. 

One way to find such a function is suggested if we try to solve an apparently 
more difficult problem: find a differ entiable function / such that 

f(* + y) = /(*) ' /GO for all x and jy, 
/(I) = io. 

Assuming that such a function exists, we can try to find/ 7 — knowing the deriv- 
ative of / might provide a clue to the definition of / itself. Now 

h~+o h 

= lim 

h-*o h 

= fix) - hm 

h-+o n 

The answer thus depends on 

/(0) = hm ; 

for the moment assume this limit exists, and denote it by a. Then 

fix) =<x-fix) for all x. 

Even if a could be computed, this approach seems self-defeating. The deriva- 
tive of / has been expressed in terms of / again. 

If we examine the inverse function/ 1 — logio, the whole situation appears 
in a new light: 

1 1 



vfiTKx)) "x 

The derivative of f~ l is about as simple as one could ask! And, what is even 
more interesting, of all the integrals / x n dx examined previously, the integral 

/ x 1 dx is the only one which we cannot evaluate. Since logio 1 = 0 we 
should have 

1 f x l 

- J ~ dt = logio x - logio 1 = logio x. 



The Logarithm and Exponential Functions 285 



DEFINITION 



This suggests that we define logi 0 x as (\/a) t~ l dt. The difficulty is that 
a is unknown. One way of evading this difficulty is to define 

kg*- I -dt, 

and hope that this integral will be the logarithm to some base, which might be 
determined later. In any case, the function defined in this way is surely more 
reasonable, from a mathematical point of view, than logi 0 . The usefulness 
of logio depends on the important role of the number 10 in arabic notation 
(and thus ultimately on the fact that we have ten fingers), while the function 
log provides a notation for an extremely simple integral which cannot be 
evaluated in terms of any functions already known to us. 



If x > 0, then 



dt. 



The graph of log is shown in Figure 1. Notice that if x > 1, then log x > 0, 
and if 0 < x < 1, then log x < 0, since, by our conventions, 



( x -dt= - { l -dt<o. 

Jl t Jx t 



For x < 0, a number log x cannot be defined in this way, because f(t) = 1/t is 
not bounded on [x, 1]. 




area = log ,v 




FIGURE 1 

The justification for the notation "log" comes from the following theorem. 
theorem l If x, y > 0, then 

log(*y) = log x + log y. 

PROOF Notice first that log'(*) = 1/x, by the Fundamental Theorem of Calculus. 
Now choose a number y > 0 and let 

/(*) = log(*y). 
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Then 



1 1 

/'(*) = log'foO -y = — • y = - 
xy x 



COROLLARY 1 

PROOF 
COROLLARY 2 

PROOF 



Thus /' = log'. This means that there is a number c such that 
f(x) — log x + c for all x > 0, 

that is, 

log(ry) = log # + c for all * > 0. 

The number c can be evaluated by noting that when x — 1 we obtain 

log(l -y) = log 1 + c 
— c. 

Thus 

\og(xy) = log x + log for all x. 
Since this is true for all y > 0, the theorem is proved. | 

If n is a natural number and x > 0, then 

log(# n ) = log x. 

Left to you (use induction). | 

If x y y > 0, then 

log0^ = log x - logy. 
This follows from the equations 

log x = log (^ m yj = lo g + lo S J- 1 

Theorem 1 provides some important information about the graph of log. 
The function log is clearly increasing, but since \og'(x) = 1/x, the derivative 
becomes very small as x becomes large, and log consequently grows more and 
more slowly. It is not immediately clear whether log is bounded or unbounded 
on R. Observe, however, that for a natural number n, 

log(2 w ) = n log 2 (and log 2 > 0); 

it follows that log is, in fact, not bounded above. Similarly, 

log = log 1 - log 2 n = -n log 2; 

therefore log is not bounded below on (0, 1). Since log is continuous, it actually 
takes on all values. Therefore R is the domain of the function log -1 . This 
important function has a special name, whose appropriateness will soon be- 
come clear. 
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FIGURE 2 



DEFINITION 



The "exponential function," exp, is defined as log 



The graph of exp is shown in Figure 2. Since log x is defined only for x > 0, 
we always have exp(x) > 0. The derivative of the function exp is easy to 
determine. 



THEOREM 2 For all numbers x, 



exp'(x) = exp(#). 



PROOF 



exp'(*) = Gog-yw 
1 



1 



log'flog-K*)) 



1 



log \x) 
= log -1 <>) = expO). | 

A second important property of exp is an easy consequence of Theorem 1 . 

THEOREM 3 If x and y are any two numbers, then 

exp (a: + y) = exp(x) • exp(j). 
PROOF Let x f — exp(#) and / = exp (y), so that 




Then 



This means that 



x = log 
y = log/. 

x + y = log x' + logy' = log(x'y'). 



cxp(x + y) = x'y' = expO) • exp(jv). | 



This theorem, and the discussion at the beginning of this chapter, suggest 
that exp(l) is particularly important. There is, in fact, a special symbol for 
this number. 



DEFINITION 



e = exp(l). 



This definition is equivalent to the equation 

f e 1 

1 = log e = / - dt. 

Ji t 
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FIGURE 3 



DEFINITION 



As illustrated in Figure 3, 

[2 i 

J - dt < 1, since 1 • (2 — 1) is an upper sum fpr 
/(/) = l/*on [1,2], 

/ - </* > 1, since £ • (2 - 1) + £ • (4 - 2) = 1 is a lower 
7i t 

sum for /(/) = 1/t on [1, 4]. 



and 



Thus 



which shows that 



\ -dt < -dt < -dt, 
Ji t Ji t Ji t 



2 < e < 4. 



In Chapter 1 9 we will find much better approximations for e, and also prove 
that e is irrational (the proof is much easier than the proof that tt is irrational !) . 
As we remarked at the beginning of the chapter, the equation 



implies that 



exp(# + y) = expO) ■ exp(j) 

exp(*) = [exp(l)]* 

= e*, for all rational x. 



Since exp is defined for all x and expO) = for rational x, it is consistent with 
our earlier use of the exponential notation to define e x as exp(Y) for all x. 



DEFINITION 


For any number x, 








e x = exp(#). 



The terminology £ 'exponential function" should now be clear. We have 
succeeded in defining e x for an arbitrary (even irrational) exponent x. We have 
not yet defined a x , if a e, but there is a reasonable principle to guide us in 
the attempt. If x is rational, then 

a x = (yoga)* = ^loga^ 

But the last expression is defined for all x, so we can use it to define a x . 



If a > 0, then, for any real number x, 

(If a = e this definition clearly agrees with the previous one.) 



The requirement a > 0 is necessary, in order that log a be defined. This is 
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\ 








/(a) = 1 






FIGURE 4 


THEOREM 4 



PROOF 




FIGURE 5 



not unduly restrictive since, for example, we would not even expect 

(-1)1/2 i v^T 

to be denned. (Of course, for certain rational *, the symbol a x will make sense, 
according to the old definition; for example, 

(-1)1/3 = = _1.) 

Our definition of a x was designed to ensure that 
(f)v = e *v for all x and y. 

As we would hope, this equation turns out to be true when e is replaced by any 
number a > 0. The proof is a moderately involved unraveling of terminology 
At the same time we will prove the other important properties of a x 

If a > 0, then 

(1) (a b ) c = a bc for all b, c. 

(Notice that a h will automatically be positive, so (a b ) c will be defined); 

(2) a 1 = a and a x+v = a x • a v for all *, y. 

(Notice that (2) implies that this definition of a x agrees with the old one for 
rational x.) 

^ ^J>y _ ^cloga* _ ^clog (e blo «°) = g c (& log a) _ ^c6Ioga _ ^ 

(Each of the steps in this string of equalities depends upon our last definition, 
or the fact that exp = log -1 .) 

(2) a l = e lloga = e lo * a = a, 

a x+y = e (x+y)loga = ^loga-h/loga = ^sloga . ^l/loga = fl * . | 

Figure 4 shows the graphs of /(*) = a* for several different a. The behavior 
of the function depends on whether 0<l,<z = l,or<z>l. If a = 1, then 
f(x) = l x = 1. Suppose a > 1. In this case log a > 0. Thus, 

if * < 7, 

then x log a < y log a, 

so ^ loga < ^ loga , 

i.e., a x < a v . 

Thus the function /(*) - a* is increasing. On the other hand, if 0 < a < 1, so 
that log a < 0, the same sort of reasoning shows that the function /(*) = a x is 
decreasing. In either case, if a > 0 and a * 1, then/(*) = a* is one-one. Since 
exp takes on every positive value it is also easy to see that a x takes on every 
positive value. Thus the inverse function is defined for all positive numbers, 
and takes on all values. If /W = a x , then f~ l is the function usually denoted 
by log a (Figure 5). 



Just as a* can be expressed in terms of exp, so log a can be expressed in terms 
of log. Indeed, 



In other words, 



if 


y 


= loga X, 


then 


X 


= a V = e V\oga^ 


so 


log* 


= y log a, 


or 


y 


_ log * 






loga 




loga X 


log X 




loga 



The derivatives of f(x) = a 1 and £(*) = log a x are both easy to find: 

/to = «* Iog °, so /'(*) = log a ■ <?^ a = log a • a*, 

,(,)-|28f, sog'W=_J_. 
log a * log a 

A more complicated function like 

/to = g(*) hix) 

is also easy to differentiate, if you remember that, by definition, 

it follows from the Chain Rule that 

/'to = • Fa'W log + 

= £to w • [*'(*) log^to + A(*) 

L £to J 

There is no point in remembering this formula — simply apply the principle 
behind it in any specific case that arises; it does help, however, to remember 
that the first factor in the derivative will be g(x) Hx) . 

There is one special case of the above formula which is worth remembering. 
The function f(x) = x a was previously defined only for rational a. We can now 
define and find the derivative of the function f(x) = x a for any number a; the 
result is just what we would expect: 



so 

a 
x 



f(x) = x a = e* 10 **, 

/'(*) = ?.,«l og x = °L. x a . ax a- K 



Algebraic manipulations with the exponential functions will become second 
nature after a little practice— just remember that all the rules which ought to 
work actually do. The basic properties of exp are still those stated in Theorems 
2 and 3: 
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exp'(*) = exp(tf), 
exp(* + y) - exp(*) • exp(jy). 

In fact, each of these properties comes close to characterizing the function exp. 
Naturally, exp is not the only function / satisfying /' = /, for if / = cf , then 
f(x) = = /(*); these functions are the only ones with this property, 
however. 



THEOREM 5 If / is differentiable and 

/'(*) = /(*) for all *, 
then there is a number c such that 

/(*) = ce* for all *. 

proof Let 

*w - — 

(This is permissible, since ** ^ 0 for all x.) Then 

Therefore there is a number c such that 

= M. = c for all x. | 

The second basic property of exp requires a more involved discussion. The 
function exp is clearly not the only function / which satisfies 

f(*+y) -/W-/W- 

In fact, /(*) = 0 or any function of the form f(x) = a* also satisfies this equa- 
tion. But the true story is much more complex than this — there are infinitely 
many other functions which satisfy this property, but it is impossible, without 
appealing to more advanced mathematics, to prove that there is even one 
function other than those already mentioned! It is for this reason that the 
definition of 10* is so difficult: there are infinitely many functions / which 
satisfy 

f(*+y) =/W7W ? 
/(i) = io, 

but which are not the function /(*) = 10*! One thing is true however— any 
continuous function / satisfying 

f(x+y) =/W'/W 
must be of the form /(*) = a x or /(*) = 0. (Problem 27 indicates the way to 
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prove this, and also has a few words to say about discontinuous functions with 
this property.) 

In addition to the two basic properties stated in Theorems 2 and 3, the 
function exp has one further property which is very important— exp "grows 
faster than any polynomial." In other words, 



THEOREM 6 For any natural number n, 




lim — = oo . 



PROOF The proof consists of several steps. 

Step 2. e* > x for all x, and consequently lim e x = oo (this may be con- 
sidered to be the case n = 0). 

To prove this statement (which is clear for x < 0) it suffices to show that 

x > log x for all x > 0. 

If x < 1 this is clearly true, since log x < 0. If x > 1, then (Figure 6) x - 1 is 
an upper sum for f(t) = 1/t on [1, x], so log x < x - 1 < x. 

e x 

Step 2. lim — = oo. 

it— ► oo X 



To prove this, note that 

e* e* 12 • e x/2 




FIGURE 6 



By Step 1, the expression in parentheses is greater than 1, and lim e* 12 = oo ; 
this shows that lim e x /x = oo. 



Step 3, lim — = oo . 
x 11 

Note that 

e_ _ (f ln y i ( e xln \ n 

The expression in parentheses becomes arbitrarily large, by Step 2, so the wth 
power certainly becomes arbitrarily large. | 

It is now possible to examine carefully the following very interesting func- 
tion: f{x) = e-v*\ x ^ 0. We have 



A*) 

X 3 
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Therefore, 

/'(*) < 0 for x < 0, 
/'(*) > 0 for x > 0, 

so /is decreasing for negative x and increasing for positive x. Moreover, if \x\ is 
large, then x 2 is large, so — 1 fx 2 is close to 0, so e~ lfxi is close to 1 (Figure 7). 



FIGURE 7 



The behavior of/ near 0 is more interesting. If x is small, then 1/x 2 is large, 
so e llxl is large, so e~ llx2 = 1/ (e 1/xi ) is small. This argument, suitably stated 
with e's and 5's, shows that 

lim e~ l ' xl = 0. 

x— >0 

Therefore, if we define 

/w 1 o, * = 0, 

then the function / is continuous (Figure 8). In fact, / is actually differentiable 




FIGURE 8 



at 0: Indeed 



/'(0) = lim — 
*->o h 

1 

h 



= lim 



Wc already know that 



it is all the more true that 



and this means that 



lim — = oo ; 
x—* » X 



e (x>) 

lim = oo, 

Z-+00 X 



lim — = 0. 



Thus 



e-U** x 9* 0 



0, 



x = 0. 



We can now compute that 



*->o h 



= lim 



2 
A» 



A-0 A 



r 2^-^ A 4 2* 4 

= hm — = hm —77- = lim — -; 

an argument similar to the one above shows that /"(0) = 0. Thus 



0, 



x = 0. 



This argument can be continued. In fact, using induction it can be shown 
(Problem 29) that (0) = 0 for every k. The function / is extremely flat at 0, 




L x \ = ( sin 1/x, x ^ 0 
\ 0, x = 0 



FIGURE 9 
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and approaches 0 so quickly that it can mask many irregularities of other 
functions. For example (Figure 9), suppose that 



fix) 



X 5* 0 
X 

0, x = 0. 



It can be shown (Problem 30) that for this function it is also true that 
/< fc >(0) = 0 for all k. This example shows, perhaps more strikingly than any 
other, just how bad a function can be, and still be infinitely differentiable. In 
Part IV we will investigate even more restrictive conditions on a function, 
which will finally rule out behavior of this sort. 

PROBLEMS 

1. Differentiate each of the following functions (remember that a b * always 
denotes a m ). 

(i) /(*) = 

(ii) f(x) = log(l + log(l + log(l + e^ + *))). 
(hi) f(x) = (sin *) sin (sinX) . 

(iv) f(x) = eUo'**)- 

(v) f( x ) = sin x*' 1 **™'. 

(vi) f(x) = logc) sin x. 

[/ x \~| log (sine*) 
arcsin ( -7— II 

(viii) f(x) = (log(3 + e^))e^ + (arcsin *) lo « 3 . 

(ix) f{x) - (log xY°**. 

(x) f{x) = x*. 

2. Graph each of the following functions. 

(a) fix) = e x+1 . 

(b) fix) = 

( c ) fix) = e* + e x . \ (Compare the graphs with the graphs of exp and 

(d) fix) = e x - e~\ I 1/exp.) 

^ _ -x 2X _ 1 9 

(e) fix) = = '— 4 = 1 - ^ 



^ + e~ x e 2 * + 1 + 1 

Find the following limits by l'Hopital's Rule. 

(I) hm 

.... - 1 - x - * 2 /2 - x 3 /6 

(II) hm 



e x - \ - x - x 2 /2 
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(cos x, sin x) 




(b) 



FIGURE 10 



(iv) lim 



(v) lim 



log(l + x) - x + x 2 /2 

X 2 

log(l + jfl - * + * 2 /2 



(vi) lim log0+^)^^ + ^/2-^/3 



4. The functions 



sinh a: = 
cosh x = 



g x - e~ 
2 

e* + C 



tanh # = =1 1 

e x + e~ x e 2x + 1 

are called the hyperbolic sine, hyperbolic cosine, and hyperbolic 
tangent, respectively (but usually read sinch, cosh, and tanch). There 
are many analogies between these functions and their ordinary trigo- 
nometric counterparts. One analogy is illustrated in Figure 10; a proof 
that the region shown in Figure 10(b) really has area x/2 is best deferred 
until the next chapter, when we will develop methods of computing 
integrals. Other analogies are discussed in the following three problems, 
but the deepest analogies must wait until Chapter 26. If you have not 
already done Problem 2, graph the functions sinh, cosh, and tanh. 

5. Prove that 

(a) cosh 2 — sinh 2 =1. 

(b) tanh 2 + 1/cosh 2 = 1. 

(c) sinh(# + y) = sinh x cosh y + cosh x sinh y. 

(d) cosh(* + y) = cosh x cosh y + sinh x sinh y. 

(e) sinh' = cosh. 

(f) cosh' = sinh. 

(g) tanh ' - 53? 

6. The functions sinh and tanh are one-one; their inverses, denoted by arg 
sinh and arg tanh (the "argument" of the hyperbolic sine and tangent), 
are defined on R and ( — 1, 1), respectively. If cosh is restricted to [0, «> ) 
it has an inverse, denoted by arg cosh, which is defined on [1, oo). 
Prove, using the information in Problem 5, that 



(a) sinh (cosh -1 x) = V x 2 - 1 . 

(b) cosh(sinh- 1 Ar) = V 1 + * 2 . 
1 



(c) (sinh-TM = 



! 
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(d) (cosh-yM = , 1 for x > 1. 

V x 2 - 1 

(e) (tadT^'M = for 1*1 < L 

7. (a) Find an explicit formula for sintT 1 , cosh" 1 , and tanh" 1 (by solving 
the equation y = sinlT" 1 x for x in terms of y, etc.). 
(b) Find 



A Vl H 



: dX 9 



+ X 2 

/ </x for fl,^ > 1 or a, K 1, 

; a v> _ i 

f b —^— 2 dx for W, |*| <1. 

Compare your answer for the third integral with that obtained by 
writing 

— = -[— + —} 
1 - x 2 211 - x 1 + x] 

8. Find 

(a) lim a x for 0 < a < 1. (Remember the definition!) 



X— ► 00 



(log *)« 
(log *)» 



(b) lim 

(c) lim 

( -i)^iogiy 

(d) lim *(log x) n . Hint: *(log x) n = — 

(e) lim x*. 

x-»0+ 

9. Graph f(x) = x* for x > 0. (Use Problem 8(e).) 

10. (a) Find the minimum value of /(*) = e x /x n for x > 0, and conclude 

that /(*) > e n /n n for at > «. 
(b) Using the expression /'(*) = e*(x - n)/x n+1 , prove that /'(*) > 
e n+1 /(n + l) n+1 for x > n + 1, and thus obtain another proof that 
lim f(x) = co. 

X — ► 00 

11. Graph /(*) = *7* n - 

12. (a) Find lim log(l + y)/y. (You can use l'Hopital's Rule, but that 

l/-»0 

would be silly.) 
(b) Find lim x log(l + 1 A). 
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(c) Prove that ^ = lim (1 + 1 /*)* 

x—* 00 

(d) Prove that e a = lim (1 + a/x) x . (It is possible to derive this from 

x— » 00 

part (c) with just a little algebraic fiddling.) 
*(e) Prove that log b = lim x(b 1/x - 1). 

13. Graph /(*) = (1 + \/x) x for * > 0. (Use Problem 12(c).) 

14. If a bank gives a percent interest per annum, then an initial investment I 
yields 1(1 + a/100) after 1 year. If the bank compounds the interest 
(counts the accrued interest as part of the capital for computing interest 
the next year), then the initial investment grows to 1(1 + a/100) n after 
n years. Now suppose that interest is given twice a year. The final amount 
after n years is, alas, not 1(1 + a/100) 2n y but merely 1(1 + a/ 200) 2n — 
although interest is awarded twice as often, the interest must be halved 
in each calculation, since the interest is a/2 per half year. This amount 
is larger than 1(1 + a/100) 71 , but not that much larger. Suppose that the 
bank now compounds the interest continuously, i.e., the bank considers 
what the investment would yield when compounding k times a year, and 
then takes the least upper bound of all these numbers. How much will an 
initial investment of 1 dollar yield after 1 year? 

15. Let/(*) = log |*| for x ^ 0. Prove that f(x) = 1/x for x ^ 0. 

*16. Prove that if /' = cf for some number c, then f(x) — ke cz for some 
number k. 

*17. A radioactive substance diminishes at a rate proportional to the amount 
present (since all atoms have equal probability of disintegrating, the 
total disintegration is proportional to the number of atoms remaining). 
If A(t) is the amount at time t, this means that A'(t) = cA(t) for some c 
(which represents the probability that an atom will disintegrate). 

(a) Find A(t) in terms of the amount A 0 = A(0) present at time 0. 

(b) Show that there is a number r (the "half-life" of the radioactive ele- 
ment) with the property that A(t + r) = A(t)/2. 

*18. Newton's law of cooling states that an object cools at a rate proportional 
to the difference of its temperature and the temperature of the surround- 
ing medium. Find the temperature T(t) of the object at time t, in terms 
of its temperature T 0 at time 0, assuming that the temperature of the 
surrounding medium is kept at a constant, M. Hint: To solve the differen- 
tial equation expressing Newton's law, remember that V = (T — M)'. 

*19. Prove that if /(*) = j* f(t) dt, then / - 0. 

*20. Find all functions / satisfying /'(0 = f(t) + J* /(/) dt. 
21. (a) Prove that 

1 + * + Tx + Ti + ' ' ' + -* ^ e * for * > 0. 



Hint: Use induction on n, and compare derivatives. 
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(b) Give a new proof that lim e x /x n = <*> . 

X-*oo 

Give yet another proof of this fact, using the appropriate form of PHopi- 
tal's Rule. (See Problem 11-38.) 

A point P is moving along a line segment AB of length 10 7 while another 
point Q moves along an infinite ray (Figure 11). The velocity of P is 
always equal to the distance from P to B (in other words, if P[t) is the 
position of P at time t, then P'{i) = 10 7 - P(t)), while Q moves with 
constant velocity Q'(t) = 10 7 . The distance traveled by Q after time t is 
defined to be the Napierian logarithm of the distance from P to B at time /. 
Thus 

10 7 * = Nap log[10 7 - P(t)l 

This was the definition of logarithms given by Napier (1550-1617) in his 
publication of 1614, Mirifici logarithmonum canonis description (A Descrip- 
tion of the Wonderful Law of Logarithms) ; work which was done before 
the use of exponents was invented! The number 10 7 was chosen because 
Napier's tables (intended for astronomical and navigational calcula- 
tions), listed the logarithms of sines of angles, for which the best possible 
available tables extended to seven decimal places, and Napier wanted to 
avoid fractions. Prove that 

10 7 

Nap log x - 10 7 log 

Hint: Use the same trick as in Problem 18 to solve the equation for P . 

(a) Sketch the graph of f(x) = (log x)/x (paying particular attention 
to the behavior near 0 and oo). 

(b) Which is larger, e* or ir e ? 

(c) Prove that if 0 < x < 1, or x = e, then the only number y satisfying 
x y = y x i s y = x; but if x > 1, x 5* e, then there is precisely one 
number y 5* x satisfying x y = y x \ moreover, if x < e, then y > e, 
and if x > e, then y < e. (Interpret these statements in terms of the 
graph in part (a) !) 

(d) Prove that if x and y are natural numbers and x y = y x > then x = y 
or x = 2, y = 4, or x — 4, y = 2, 

(e) Show that the set of all pairs (x, y) with x y = y x consists of a curve 
and a straight line which intersect; find the intersection and draw a 
rough sketch. 

**(f) For 1 < x < e let g{x) be the unique number > e with x° ix) = 
g(x) x . Prove that g is differentiate. (It is a good idea to consider 
separate functions, 

f x (x) = 0<x<e 
x 

x 
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and write g in terms of fi and / 2 . If you do this part properly you 
should be able to show that 

rt4.JfflL.lzi.) 

1 - log g(x) X 2 / 
*25. This problem uses the material from the Appendix to Chapter 11. 

(a) Prove that exp is convex and log is concave. 

n 

(b) Prove that if £ p t ■ = 1 and all pi > 0, then 

t = i 

' . . . • z n *>» < p lZl + • • ■ + /> n z n . 

(Use Problem 8 from the Appendix to Chapter 11.) 

(c) Deduce another proof that G n < A n (Problem 2-20). 

26. Suppose / satisfies /' = / and f(x + y) = f(x)f(y) for all x and y. Prove 
that / — exp or / = 0. 

*27. Prove that if / is continuous and f(x + y) = f(x)f(y) for all x and jy, then 
either / = 0 or /(*) = [/(l)] z for all x. Hint: Show that /(*) = [/(l)]* 
for rational and then use Problem 8-6. This problem is closely related 
to Problem 8-7, and the information mentioned at the end of Problem 
8-7 can be used to show that there are discontinuous functions / satisfy- 
ing /(* + y) = f(x)f(y). 

*28. Prove that if / is a continuous function defined on the positive reals, and 
f(xy) = f(x) + f(y) for all positive x and y, then / = 0 or f(x) = 
f(e) log x for all x > 0. Hint: Consider g(x) = /(<?*). 

*29. Prove that if f(x) = e~ 1 ^ for x ^ 0, and /(0) = 0, then /< fc) (0) = 0 for 
all k. 

*30. Prove that if f(x) = ^ 1 ^ 2 sin 1/x for ^ ^ 0, and /(0) = 0, then f k \0) = 
0 for all £. 

31. (a) Prove that if a is a root of the equation 

(*) a n x n + fln-i*"" 1 + ■ • • + aix + a 0 = 0, 

then the function y (x) = satisfies the differential equation 

(**) a n y {n) + a n ^y^ + • • • + + - 0. 

*(b) Prove that if a is a double root of (*), then y(x) = ^ ax also satisfies 
(**). Hint: Remember that if a is a double root of a polynomial 
equation f(x) = 0, then f'(a) = 0. 

*(c) Prove that if a is a root of (*) of order r, then y(x) = x k e ax is a solu- 
tion for 0 < k < r - 1. 

If (*) has « real numbers as roots (counting multiplicities), part (c) 
gives n solutions y l9 . . . , y n of (**). 

(d) Prove that in this case the function Ciyi + • ■ * + c n y n also 
satisfies (**). 
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It is a theorem that in this case these are the only solutions of (**). 
Problem 16 and the next two problems prove special cases of this 
theorem, and the general case is considered in Problem 19-17. 
In Chapter 26 we will see what to do when (*) does not have n real 
numbers as roots. 

*32. Suppose that / satisfies /" - / = 0 and /(0) = /'(0) = 0. Prove that 
/ = 0 as follows. 

(a) Show that/ 2 - (/') 2 = 0. 

(b) Suppose that f{x) ^ 0 for all x in some interval (a, b). Show that 
either f(x) = ce x or else /(#) = ce~ x for all x in {a, b) ) for some 
constant c. 

**(c) If/(*o) ^ 0 for x 0 > 0, say, then there would be a number a such 
that 0 < a < x 0 and f(a) = 0, while fix) ^ 0 for a < x < x 0 . 
Why? Use this fact and part (b) to deduce a contradiction. 

*33. (a) Show that if / satisfies /" - / = 0, then f(x) = ae x + be~ x for some 
a and b. (First figure out what a and b should be in terms of /(0) 
and f(0), and then use Problem 32.) 
(b) Show also that / = a sinh + b cosh for some (other) a and b. 
34. Find all functions / satisfying 

(a) /<«> = /(--i). 

(b) /<*> = f n ~*\ 

*35. This problem, a companion to Problem 15-28, outlines a treatment of 
the exponential function starting from the assumption that the differen- 
tial equation f'=f has a nonzero solution. 

(a) Suppose there is a function / 9^ 0 with /' = /. Prove that f(x) ^ 0 
for each x by considering the function g(x) = f(x 0 + x)f(x 0 — x), 
where f(x 0 ) 5* 0. 

(b) Show that there is a function / satisfying f~f and /(0) = 1 . 

(c) For this / show that f(x + y) = f(x) • f(y) by considering the func- 
tion g(x) = f(x+y)/f(x). 

(d) Prove that / is one-one and that (/~~ *)'(*) = l/x. 

**36. A function / is said to grow faster than g if lim f(x)/g(x) — 00. For 

X — ► 00 

example, exp grows faster than any polynomial function. Suppose that 
gi, g2, gi, . . • are continuous functions. Show that there is a continuous 
function / which grows faster than each gi. 
37. Prove that logi 0 2 is irrational. 
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CHAPTER | W7 INTEGRATION IN ELEMENTARY TERMS 



Every computation of a derivative yields, according to the Second Funda- 
mental Theorem of Calculus, a formula about integrals. For example, 

if F(x) — *(log x) — x, then F f (x) = log x; 

consequently, 

J*\ogxdx = F{b) - F(a) = b(log b) - b - [a{\og a) - a\ 0 < a, b. 
Formulas of this sort are simplified considerably if we adopt the notation 

F(x) T = F(b) - F{a). 

We may then write 

J* log x dx = x(log x) — x |\ 

This evaluation of J* log x dx depended on the lucky guess that log is the 
derivative of the function F(x) = x(\og x) — x. In general, a function F 
satisfying F' — f is called a primitive of /. Of course, a continuous function / 
always has a primitive, namely, 

*w = /;/> 

but in this chapter we will try to find a primitive which can be written in 
terms of familiar functions like sin, log, etc. A function which can be written 
in this way is called an elementary function. To be precise,* an elementary 
function is one which can be obtained by addition, multiplication, division, 
and composition from the rational functions, the trigonometric functions and 
their inverses, and the functions log and exp. 

It should be stated at the very outset that elementary primitives usually 
cannot be found. For example, there is no elementary function F such that 

F'(x) = e~ x * for all x 

(this is not merely a report on the present state of mathematical ignorance; it 
is a (difficult) theorem that no such function exists) . And, what is even worse, 
you will have no way of knowing whether or not an elementary primitive can 
be found (you will just have to hope that the problems for this chapter contain 

* The definition which we will give is precise, but not really accurate, or at least not quite 
standard. Usually the elementary functions are defined to include "algebraic" functions, 
that is, functions g satisfying an equation 

(g(x)) n +fn-l(x)(g(*)) n - l + • • ' +/oW = 0, 

where the /»• are rational functions. But for our purposes these functions can be ignored. 
302 



Integration in Elementary Terms 303 



no misprints). Because the search for elementary primitives is so uncertain, 
finding one is often peculiarly satisfying. If we observe that the function 

log(l + * 2 ) 
F(x) = x arctan x — — ■ 

satisfies 

F f (x) = arctan x 

(just how we would ever be led to such an observation is quite another matter), 
so that 



f. 



* log(l + x 2 ) 
arctan x ax — x arctan x 



then we may feel that we have "really" evaluated j* arctan x dx. 

This chapter consists of little more than methods for finding elementary 
primitives of given elementary functions (a process known simply as "integra- 
tion"), together with some notation, abbreviations, and conventions designed 
to facilitate this procedure. This preoccupation with elementary functions can 
be justified by three considerations: 

(1) Integration is a standard topic in calculus, and everyone should 
know about it. 

(2) Every once in a while you might actually need to evaluate an integral, 
under conditions which do not allow you to consult any of the 
standard integral tables (for example, you might take a (physics) 
course in which you are expected to be able to integrate). 

(3) The most useful "methods" of integration are actually very impor- 
tant theorems (that apply to all functions, not just elementary ones). 

Naturally, the last reason is the crucial one. Even if you intend to forget 
how to integrate (and you probably will forget some details the first time 
through), you must never forget the basic methods. 

These basic methods are theorems which allow us to express primitives of 
one function in terms of primitives of other functions. To begin integrating we 
will therefore need a list of primitives for some functions; such a list can be 
obtained simply by differentiating various well-known functions. The list 
given below makes use of a standard symbol which requires some explanation. 
The symbol 

//or Jf(x)dx 

means "a primitive of/" or, more precisely, "the collection of all primitives 
of /." The symbol jf will often be used in stating theorems, while //(*) dx is 
most useful in formulas like the following: 



This "equation" means that the function F(x) = * 4 /4 satisfies F'(x) = # 3 . It 
cannot be interpreted literally because the right side is a number, not a func- 
tion, but in this one context we will allow such discrepancies; our aim is to 
make the integration process as mechanical as possible, and we will resort to 
any possible device. Another feature of the equation deserves mention. Most 
people write 



/ 



4 



to emphasize that the primitives of f(x) = x 3 are precisely the functions of the 
form F{x) = x z + Cfor some number C. Although it is possible (Problem 1 1) to 
obtain contradictions if this point is disregarded, in practice such difficulties 
do not arise, and concern for this constant is merely an annoyance. 

There is one important convention accompanying this notation: the letter 
appearing on the right side of the equation should match with the letter 
appearing after "d" on the left side — thus 



/ 



4 



u z du — —) 
4 



f j *** 
jtxdx = -, 



xt 2 

tx dt = — • 
2 



/ 



A function in jf(x) dx, i.e., a primitive of /, is often called an "indefinite 
integral" of /, while J* f(x) dx is called, by way of contrast, a "definite 
integral." This suggestive notation works out quite well in practice, but it is 
important not to be led astray. At the risk of boring you, the following fact is 
emphasized once again: the integral J a f(x) dx is not defined as "F(b) — F(a), 
where Fis an indefinite integral of/" (if you do not find this statement repe- 
titious, it is time to reread Chapter 13). 

We can verify the formulas in the following short table of indefinite integrals 
simply by differentiating the functions indicated on the right side. 

/ 
/ 

J -dx = log x - dx is often written J — for convenience; similar 

abbreviations are used in the last two examples of this 
table.) 

e x dx = e x 



adx = ax 

x n dx = , n 9* — 1 

n + 1 



/ 
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THEOREM 1 (INTEGRATION BY PARTS) 



J sin x dx = — cos x 

J cos x dx — sin x 

y sec 2 x dx = tan # 

y sec a: tan x dx — sec # 
/* 

/ = arctan x 

J 1 + * 2 

/■ 

/ == arcsm * 

./ VI - * 2 

Two general formulas of the same nature are consequences of theorems 
about differentiation: 

SUM + g(*)] dx = //(*) dx + fg(x) dx, 
jc • f{x) dx = c ff(x) dx. 

These equations should be interpreted as meaning that a primitive of / + g 
can be obtained by adding a primitive of / to a primitive of g, while a primitive 
of c - f can be obtained by multiplying a primitive of / by c. 

Notice the consequences of these formulas for definite integrals: If / and g 
are continuous, then 

j* [/« + g(x)] dx = J" f{x) dx + f" g(x) dx, 
c • f(x) dx = c ' J* f(x) dx. 

These follow from the previous formulas, since each definite integral may be 
written as the difference of the values at a and b of a corresponding primitive. 
Continuity is required in order to know that these primitives exist. (Of course, 
the formulas are also true when / and g are merely integrable, but recall how 
much more difficult the proofs are in this case.) 

The product formula for the derivative yields a more interesting theorem, 
which will be written in several different ways. 

If /' and g f are continuous, then 

ffg'=fg-/ fg, 

f f(x)g'(x) dx = f(x)g(x) - / f{x)g(x) dx, 
pMg'(x) dx = f{x)g{x) I - j b J'{x)g{x) dx. 

(Notice that in the second equation f{x)g{x) denotes the function f ■ g.) 
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PROOF 



The formula 



<Jgy=f'g+fg' 



can be written 



fg' = (fg)' - fg. 



Thus 



jfg' = / (fg)' ~ Jf'g, 



and fg can be chosen as one of the functions denoted by f(fg)'. This proves 
the first formula. 

The second fomula is merely a restatement of the first, and the third 
formula follows immediately from either of the first two. | 

As the following examples illustrate, integration by parts is useful when the 
function to be integrated can be considered as a product of a function /, whose 
derivative is simpler than /, and another function which is obviously of the 
form g'. 



There are two special tricks which often work with integration by parts. 
The first is to consider the function g' to be the factor 1, which can always be 
written in. 




U 
fg' 



U 
fg 



f g 





The second trick is to use integration by parts to find fh in terms of fh again, 
and then solve for fh. A simple example is the calculation 
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or 



/ 



1, . (log *) 2 

- log xdx = — - . 

x 2 



A more complicated calculation is often required: 

J e* sin x dx = e x • ( — cos x) — J e* • ( — cos x) dx 

f g' f g f g 

= — e* cos x + I e* cos x dx 

X i 

u v' 

= — e* cos x + \e" • (sin x) — J ^(sin x) dx]; 

u v u f V 



therefore, 



or 



2 j e x sin a: dx = ^(sin # — cos #) 
**(sin * — cos x) 



e x sin xdx — 



Since integration by parts depends upon recognizing that a function is of 
the form g', the more functions you can already integrate, the greater your 
chances for success. It is frequently reasonable to do a preliminary integration 
before tackling the main problem. For example, we can use parts to integrate 

j (log x) 2 dx = j (log x) (log x) dx 
I I 
f g' 

if we recall that / log x dx = x(log x) — x (this formula was itself derived by 
integration by parts) ; we have 

j (log *)(log x) dx = (log *)[*(log *)-*]-/ (l/*)|>(log at) - *] <fc 
i A i i i i 

f i' f g f g 

= (log *)[x(log x) - x]- f [log x - 1] 

= (log x)[x(log x) — x] — J log xdx + J 1 dx 

= (log *)[*(log *) - *] - [*(log x) - x] + x 

= x(log *) 2 - 2*(log *) + 2x. 

The most important method of integration is a consequence of the Chain 
Rule. The use of this method requires considerably more ingenuity than 
integrating by parts, and even the explanation of the method is more difficult. 
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We will therefore develop this method in stages, stating the theorem for defi- 
nite integrals first, and saving the treatment of indefinite integrals for later. 

theorem 2 If / and g f are continuous, then 
(THE SUBSTITUTION FORMULA) 

O(«0«fc- /.*/(*«)■*'(*>*• 

PROOF If F is a primitive of /, then the left side is F{g(b)) - F(g(a)). On the other 
hand, 

(Fog)'= (F'*g)-g' = (fog)-g', 
soFo^isa primitive of (fog) • g' and the right side is 

(Fo g )(b) - (Fog)( a ) = F(g(b)) - F(g(a)). | 

The simplest uses of the substitution formula depend upon recognizing 
that a given function is of the form (fog) • g f . For example, the integration of 

sin 5 x cos x dx ( = j* (sin *) 5 cos x dx^j 

is facilitated by the appearance of the factor cos x, which will be the factor 
g'(x) for g(x) — sin x; the remaining expression, (sin x) 5 , can be written as 
(£(.'.')) 5 = f(g(*)), for f(u) = u\ Thus 

[ b . B , !>(*) = sinx] 

/ sin 5 a; cos a: tf* ' 

7a lf(u) = U h J 

= / f(g(fiW(x)dx- f(u)du 
•sin 6 sm 6 £ sin 6 a 



fan a 6 6 

The integration of J* tan a; dx can be treated similarly if we write 

f b , p — sin a; . 

/ tan a; = — / 

y a J a cos a; 

In this case the factor - sin x is g'(x) y where = cos x; the remaining 
factor 1/cos x can then be written /(cos *) for f(u) = 1/u. Hence 



'6 

tan x dx 



g(x) = cos X 

/(«) = 1 



= - / /(jrMk'M * = - / /(«) * 

/"cos 6 J 

= - / = log(cos a) - log(cos £). 

J cob a U 
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Finally, to find 



a X lOg X 



dx, 



notice that 1/x = g'(x) where g{x) = log x, and that 1/log x = f(g(x)) for 
f(u) = 1/w. Thus 

'g(x) = log x~ 



f a X log X 



M = - 



/■* /•»(» 

= / f(g(*))g'(x) dx = /(«)& 

Jo 7<7(o) 

=1 



log 6 1 

= log(log 6) - log(log a). 

log a U 



Fortunately, these uses of the substitution formula can be shortened con- 
siderably. The intermediate steps, which involve writing 

p(g(x))g'(x)dx = /*>/(«> du, 

can easily be eliminated by noticing the following: To go from the left side 
to the right side, 

, . ( u for p(x) 
substitute _ , ,/\ , 
( du for g (x) dx 

(and change the limits of integration); 

the substitutions can be performed directly on the original function (account- 
ing for the name of this theorem). For example, 



L 



6 . f u for sin a: 

sm 5 x cos x afx substitute r , 
L for cos x tfx 



-i /"sin 6 

I = / u* du, 

rj J sin a 



and similarly 



f b — sin x _ f , . w for cos a: 
X^T^r bStltUtC ^for-sin,^ 



1 _ rcoB&i 

J J cos a U 



du. 



Usually we abbreviate this method even more, and say simply: 



"Let u = g(x) 

du = g'(x) dx." 



Thus 



7a X 10 



log X 



- (fx 



let w = log x 

du = - dx 
x 



rioz b i 
= / -du. 

./log a 



In this chapter we are usually interested in primitives rather than definite 
integrals, but if we can find J* f(x) dx for all a and b, then we can certainly 



find J7(*) dx. For example, since 



f b . sin 6 £ sin 6 a 

sin 5 x cos x dx = 



it follows that 



Similarly, 



/ 



sin 5 x cos * = 



6 6 
sin 6 * 



y tan x dx — — log x cos #, 
/^lcb^ = l0g(l0g ^ 



log X 

It is quite uneconomical to obtain primitives from the substitution formula by 
first finding definite integrals. Instead, the two steps can be combined, to 
yield the following procedure: 



(1) Let 

u = g(x), 
du — g\x) dx; 

(after this manipulation only the letter u should appear, not the 
letter x). 

(2) Find a primitive (as an expression involving u). 

(3) Substitute g(x) back for u. 



Thus, to find 

J sin 5 x cos x dx, 

(1) let 

u — sin x, 
du — cos x dx, 

so that we obtain 

j u*du; 

(2) evaluate 

f u 6 

J u * du = V 

(3) remember to substitute sin x back for u, so that 

f • 5 j Sm6 * 

y sin 5 .*• cos xdx = — - — 

Similarly, if 

u = log #, 

du — - dx, 
x 



Integration in Elementary Terms 311 



then 

f 1 fl 

I — dx becomes / - du = log u, 

J x log X J u 



log 

so that 



/ 



dx = log (log x). 



To evaluate 



let 



x log # 

dx, 



/ 



1 + * 2 



a = 1 + x\ 

du = 2x dx; 

the factor 2 which has just popped up causes no problem— the integral 
becomes 



so 

(This result may be combined with integration by parts to yield a formula 
already mentioned: 



I 



j 1 • arctan x dx — x arctan x — J y 



+ a: 2 

= * arctan * — i log(l + x 2 ).) 

These applications of the substitution formula* illustrate the most straight- 
forward and least interesting types — once the suitable factor g'(x) is recog- 
nized, the whole problem may even become simple enough to do mentally. 
The following three problems require only the information provided by the 
short table of indefinite integrals at the beginning of the chapter and, of 
course, the right substitution (the third problem has been disguised a little by 
some algebraic chicanery). 

* The substitution formula is often written in the form 

f f(u)du= f f(g(x))g'(x) dx, u=g(x). 

This formula cannot be taken literally (after all, //(«) du should mean a primitive of / and 
If(gM)g'(x) dx should mean a primitive of (Jog)- g'; these are certainly not equal). How- 
ever, it may be regarded as a symbolic summary of the procedure which we have developed. 
If we use Leibnitz's notation, and a little fudging, the formula reads particularly well: 

du 



f f{u)du= j m^dx, 



j sec 2 x tan 5 x dx, 
x dx, 
dx. 



j (cos x)e 

/ 



If you have not succeeded in finding the right substitutions, you should be 
able to guess them from the answers, which are (tan 6 x)/6, e silix , and arcsin e x . 
At first you may find these problems too hard to do in your head, but at least 
when g is of the very simple form g(x) — ax + b you should not have to waste 
time writing out the substitution. The following integrations should all be 
clear. (The only worrisome detail is the proper positioning of the constant — 
should the answer to the second be e Zx /3 or 3e 3x ? I always take care of these 
problems as follows. Clearly Je 3x dx = e Zx • (something). Now if I differentiate 
F(x) = e Zx , I get F'(x) = 3e* x , so "something" must be i, to cancel the 3.) 



/ 

/■ 



x + 3 



log(* + 3), 



dx = — > 



I 



cos 4x dx = 



I 



sin (2x + 1) dx 



3 

sin 4x 
4 

- cos (2*.+ 1) 



/ 



2 

dx arctan 2x 



1 + 4* 2 



More interesting uses of the substitution formula occur when the factor 
g'(x) does not appear. There are two main types of substitutions where this 
happens. Consider first 

1 + e x 



f 



dx. 



i - e 

The prominent appearance of the expression ? suggests the simplifying 
substitution 

u = e x , 
du = e x dx. 

Although the expression e* dx does not appear, it can always be put in: 
J 1 - ? J 1 - e* e* 
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We therefore obtain 



/ 



1 +u 1 . 

- du, 



1 — u u 

which can be evaluated by the algebraic trick 

[LLa.lto^ f -l— + \ d u= -2iog(i -«) + io g «, 

J 1 — u u J 1 u u 

so that 



/ 



1 + e x 
1 - e x 



dx = -2 log(l - *») + log = -2 log(l ~ «*) + x. 



There is an alternative and preferable way of handling this problem, which 
does not require multiplying and dividing by e x . If we write 



u = e x , x — log u, 
dx = - du, 



then 



f _ lb ^ immediately becomes f j " * - afo. 
y 1 - e* J \ - u u 



Most substitution problems are much easier if one resorts to this trick of 
expressing x in terms of u, and dx in terms of du, instead of vice versa. It is not 
hard to see why this trick always works (as long as the function expressing u 
in terms of x is one-one for all x under consideration): If we apply the 
substitution 

u = g(x), x = g~\u) 

dx = (g-V(u) du 

to the integral 

/ /(*(*)) dx, 

we obtain 

(i) //M(f ! )'WA. 

On the other hand, if we apply the straightforward substitution 

u = g{x) 
du = g'(x) dx 

to the same integral, 

/ /(*(*)) J f(g(x)) ■ • g'(x) dx, 



we obtain 



(2) f /(«) • ,. * y du. 

J g (g H«) 



The integrals (1) and (2) are identical, since (|r _1 )'(") = 



As another concrete example, consider 



/ 



dx. 



Ve> + 1 



In this case we will go whole hog and replace the entire expression vV + 1 
by one letter. Thus we choose the substitution 

u = V> + 1, 
u 2 = e* + 1, 
* 2 - 1 = * = log(« 2 - 1), 

dx = — 

w 2 - 1 

The integral then becomes 

J u u 2 - 1 J 3 



Thus 



/ 



: A = \ {f + 1) 3/2 ~ 2[f + 1) 1/2 . 



+ 1 3 



Another example, which illustrates the second main type of substitution 
that can occur, is the integral 

f Vl - x 2 dx. 

In this case, instead of replacing a complicated expression by a simpler one, 
we will replace x by sin w, because VI — sin 2 u = cos u. This really means 
that we are using the substitution u = arcsin x, but it is the expression for x 
in terms of u which helps us find the expression to be substituted for dx. Thus, 

let x = sin u, [u = arcsin x] 
dx = cos u du; 

then the integral becomes 

j Vl — sin 2 u cos u du = j cos 2 w du. 
The evaluation of this integral depends on the equation 

1 + cos 2u 

cos 2 u = 

2 

(see the discussion of trigonometric functions below) so that 



j cos 2 u du = J ~ 



+ cos 2u _ a . sin 2w 
</w = - + 



2 2 4 
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and 

//- arcsin x . sin (2 arcsin x) 
Vl-x*d X = ^-+ - 

arcsin x . 1 . / N / N 

= h - sin (arcsin x) * cosfarcsm x) 

2 2 

= ar^ 1 V — 2 
2 2 

Substitution and integration by parts are the only fundamental methods 
which you have to learn; with their aid primitives can be found for 
a large number of functions. Nevertheless, as some of our examples reveal, 
success often depends upon some additional tricks. The most important are 
listed below. Using these you should be able to integrate all the functions in 
Problems 1 to 7 (a few other interesting tricks are explained in some of the 
remaining problems). 



1. TRIGONOMETRIC FUNCTIONS 
Since 

sin 2 x + cos 2 x = 1 

and 

cos 2x = cos 2 x — sin 2 x, 

we obtain 

cos 2x — cos 2 x — (1 — cos 2 x) = 2 cos 2 x — 1, 
cos 2x — (1 — sin 2 x) — sin 2 x = 1 — 2 sin 2 *, 

or 

1 — cos 2x 



sin 2 x = 



cos 2 x = 



2 

1 + cos 2x 



2 

These formulas may be used to integrate 

J sin 71 x dx, 
j cos n x dx, 

if n is even. Substituting 

(1 - cos 2x) (1 + cos 2x) 

or 

2 2 

for sin 2 x or cos 2 x yields a sum of terms involving lower powers of cos. For 
example, 

j sin*xdx = j ^ -^ os2 * y dx = j l -dx- j cos 2xdx + cos 2 2^^ 



and 

y cos 2 2xdx = J dx. 

If n is odd, /z = 2k + 1, then 

J sin n x dx = J sin *(1 — cos 2 x) k dx; 

the latter expression, multiplied out, involves terms of the form sin* cos* x, 
all of which can be integrated easily. The integral for cos" x is treated simi- 
larly. An integral 

j sin n x cos m x dx 

is handled the same way if n or m is odd. If n and m are both even, use the 
formulas for sin 2 x and cos 2 x. 

A final important trigonometric integral is 

/— — dx = f sec x dx = log(sec x + tan x). 
cos x J 

Although there are several ways of "deriving" this result, by means of the 
methods already at our disposal (Problem 10), it is simplest to check this 
formula by differentiating the right side, and to memorize it. 



2. REDUCTION FORMULAS 

Integration by parts yields (Problem 17) 

/sin n x dx — — - sin n_1 x cos x + f sin n ~ 2 x dx, 

n n J 

/cos n x dx = - cos n_1 x sin x + f cos n-2 x dx, 

n n J 

f 1 dx = — * + ^ f 1 *, 

J (x 2 + \) n In - 2 (x 2 + l)"' 1 In - 2 J (x 2 + l) 71 "" 1 ' 

and many similar formulas. The first two, used repeatedly, give a different 
method for evaluating primitives of sin n or cos w . The third is very important 
for integrating a large general class of functions, which will complete our 
discussion. 



3. RATIONAL FUNCTIONS 

Consider a rational function p/q where 

p(x) = a n x n + a n -ix n ~ l + • • • + <2 0 , 
q(x) = b m x m + b m ^x m ' 1 + • • • + bo. 

We might as well assume that a n = b m — 1. Moreover, we can assume that 
n < m, for otherwise we may express as a polynomial function plus a 



Integration in Elementary Terms 317 



THEOREM 



THEOREM 



rational function which is of this form by dividing (for example: 



u - 1 



u+l + 



The integration of an arbitrary rational function depends on two facts; the 
first follows from the "Fundamental Theorem of Algebra" (see Chapter 25, 
Theorem 2 and Problem 25-3), but the second will not be proved in this book. 

Every polynomial function 

q(x) =X m + brn^X**- 1 + • • • + bo 

can be written as a product 

q( x ) = (x- ai) r ' •-..'(*- a*) r *(* 2 + fa + 7i)'« * 



(where r\ + 



+ r k + 2(jx + 



(* 2 + ft* + 70 - « 



+ si) - m). 



(In this expression, identical factors have been collected together, so that all 
x — en and x 2 + fax + 7» may be assumed distinct. Moreover, we assume 
that each quadratic factor cannot be factored further. This means that 

ft 2 - 4 7 ; < 0, 

since otherwise we can factor 



a: 2 + ft* + 7,- = [* ~ ( 
into linear factors). 
If n < m and 

^(jf) = + a n __i* n - 1 + • • • + a 0j 
^0) = + b m _ lX m ~ l + * — + b 0 

= (x- ai) r » •-..•(*- at) r *(* 2 + ft* + 7i)* 
then p(x)/q(x) can be written in the form 



)] 



• (* 2 + ft* + yi)>i, 



+ 
+ 



q(x) L(* - «i) (* - ai) r J 

(at - a*) (* ~ a*) r J 

I" ^i t i-y + . ... , bi,*i x + £Mi 1 

L(* 2 + fax + 71) ' ' (* 2 + ft* + 7i) Sl J 

L(* 2 + 



+ 



.(* 2 + ft* + 7 ,) 



(* 2 + fax + 70 s ' J 



This expression, known as the "partial fraction decomposition" ofp(x)/q(x), 
is so complicated that it is simpler to examine the following example, which 
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illustrates such an expression and shows how to find it. According to the 
theorem, it is possible to write 

2x 7 + 8* 6 + 13x 5 + 20x 4 + 15* 3 + 16* 2 + 7x + 10 
(x 2 + x + 1) 2 (* 2 + 2x + 2)0 - l) 2 

a b cx + d ex + / gx + k 

+ 7 7T~n + o . „ + 7-T-; T-7T H 1 — 



x - 1 (* - l) 2 * 2 + 2a: + 2 (x 2 + at + 1) (* 2 + * + I) 2 

To find the numbers a, b, c, d, e, f, g, and h, write the right side as a polynomial 
over the common denominator (x 2 + x + l) 2 (x 2 + 2x + 3)(* — 1) 2 ; the 
numerator becomes 

«(* - 1)(* 2 + 2x + 2){x 2 + x + l) 2 + £(* 2 + 2x + 2)(* 2 + x + I) 2 
+ (cx + d)(x- l) 2 (x 2 + x+\) 2 +(ex+f)(x-\) 2 (x 2 + 2x + 2)(x 2 + x + l) 

+ (gx + h)(x- l) 2 (x 2 + 2x + 2). 

Actually multiplying this out (!) we obtain a polynomial of degree 8, whose 
coefficients are combinations of a, . . . , h. Equating these coefficients with 
the coefficients of 2x 7 + 8x 6 + 13x 5 + 20x 4 + 15x* + 16x 2 + Ix + 10 (the 
coefficient of x 8 is 0) we obtain 8 equations in the eight unknowns a, . . . 3 h. 
After heroic calculations these can be solved to give 

a = 1, b = 2, c = 1, d = 3, 
< = 0, /= 0, £ = 0, A = 1. 

Thus 



/ 



2x 7 + 5x« + 13x 5 + 20* 4 + 21x 3 + 16x 2 + Ix + 4 J 



i f , r * + 3 , 



(* 2 + x + 1) V + 2x + 2)(x - l) 2 

- j r jx^T) dx + i ^c^^^^ + /c^H-i + i>»^ + /^ + ^ + 2- 

(In simpler cases the requisite calculations may actually be feasible. I obtained 
this particular example by starting with the partial fraction decomposition and 
converting it into one fraction.) 

We are already in a position to find each of the integrals appearing in the 
above expression; the calculations will illustrate all the difficulties which arise 
in integrating rational functions. 

The first two integrals are simple: 

j 1 ' dx = log(x - 1), 



X - 1 

2 " 2 



(* - l) 2 x - 1 

The third integration depends on " completing the square 5 
x 2 + x + 1 = (* + i) 2 + f 
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(If we had obtained — f instead of f we could not take the square root, but in 
this case our original quadratic factor could have been factored into linear 
factors.) We can now write 



The substitution 



x + i 
u = — 

du = -j^dx, 



changes this integral to 



i f yl d 

3 J ( W 2 + l) 2 



which can be computed using the third reduction formula given above. 
Finally, to evaluate 

x + 3 



/ 



• dx 



(* 2 + 2x + 2) 
we write 

[ * + 3 dx-'-f 2X + 2 dx+ f 2 dx. 

J x* + 2x + 2 2 J x> + 2x + 3 ^ J (x + l) 2 + 1 

The first integral on the right side has been purposely constructed so that we 
can evaluate it by using the substitution 

u = x 2 + 2x + 3, 
du = (2x + 2) dx. 

The second integral on the right, which is just the difference of the other two, 
is simply 2 arctan (x + 1). If the original integral were 

f -* + 3 1 /• 2* + 2 f 2 ^ 

J (x> + 2x + 2)» * 2 J (x> + 2x + 2Y * ^ J [(x + l) 2 + l] n ' 

the first integral on the right would still be evaluated by the same substitution. 
The second integral would be evaluated by means of a reduction formula. 

This example has probably convinced you that integration of rational func- 
tions is a theoretical curiosity only, especially since it is necessary to find the 
factorization of q{x) before you can even begin. This is only partly true. We 
have already seen that simple rational functions sometimes arise, as in the 
integration 

1 + * j 

: dx; 



J 



1 - e> 



another important example is the integral 




- 1 



i_ A = ilog(* - 1) - llog(*+l). 

-p 1 z Z 



Moreover, if a problem has heen reduced to the integration of a rational func- 
tion, it is then certain that an elementary primitive exists, even when the diffi- 
culty or impossibility of finding the factors of the denominator may preclude 
writing this primitive explicitly. 

PROBLEMS 

1. This problem contains some integrals which require little more than 
algebraic manipulation, and consequently test your ability to discover 
algebraic tricks, rather than your understanding of the integration 
processes. Nevertheless, any one of these tricks might be an important 
preliminary step in an honest integration problem. Moreover, you want 
to have some feel for which integrals are easy, so that you can see when 
the end of an integration process is in sight. The answer section, if you 
resort to it, will only reveal what algebra you should have used. 




(v) 



/ 



tan 2 x dx. 



(Trigonometric integrals are always very touchy, 
because there are so many trigonometric identities 
that an easy problem can easily look hard.) 
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2. The following integrations involve simple substitutions, most of which 
you should be able to do in your head. 

(i) J e* sin e* dx. 

(ii) J xe~ xl dx. 

/log x 
dx. (In the text this was done by parts.) 
x 

r \ f ^ dx 

(iv) / 

J e 2 * + 2e x + 1 

(v) j e**e x dx. 
, , x f x dx 

(vii) j ~^dx. 

(viii) J xVl - x 2 dx. 

(ix) J log (cos x) tan x dx. 

7 * log X 

3. Integration by parts. 

(i) J x 2 e* dx. 

(iii) j e ax sin bx dx. 



(iv) y si 

(v) j (log*) 

(vi) J l ^MA dx 



sin # 



(vii) / scc 3 xdx. (This is a tricky and important integral that often 

comes up. If you do not succeed in evaluating it, be 
sure to consult the answers.) 

(viii) j cos (log x) dx. 



(ix) j V# log x dx. 

(x) j *(log x) 2 dx. 



The following integrations can all be done with substitutions of the form 
x = sin u, x = cos u, etc. To do some of these you will need to remember 
that 

/ sec x dx = log (sec x + tan x) 

as well as the following formula, which can also be checked by differ- 
entiation: 

J esc x dx = — log (esc x + cot x). 

In addition, at this point the derivatives of all the trigonometric func- 
tions should be kept handy. 

f dx 

(i) / (You already know this integral, but use the sub- 

v * ~~ x stitution x — sin u anyway, just to see how it works 
out.) 

(ii) f ^ X (Since tan 2 u + 1 = sec 2 u, you want to use the 

V 1 + x 2 substitution x = tan u.) 



dx 



(iii) , / — 
J Vx 2 - 1 

r dx 

(iv) / . (The answer will be a certain inverse function that 

x v x 2 — 1 was gi ven short shrift in the text.) 

dx 



Vl - x 2 

dx 



w /.- 

(vi) f - , 

J xV\ + X 2 

(vii) J x s Vl - x 2 dx. I (Yqu wiU need tQ remember the methods for 

// ( integrating powers of sin and cos.) 

V 1 — x 2 dx. J 

(ix) J Vl + x 2 dx. 

(x) |V?=T*. 

The following integrations involve substitutions of various types. There 
is no substitute for cleverness, but there is a general rule to follow: substi- 
tute for an expression which appears frequently or prominently; if two 
different troublesome expressions appear, try to express them both in 
terms of some new expression. And don't forget that it usually helps to 
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express x directly in terms of u, to find out the proper expression to sub- 
stitute for dx. 



a) r — 

J 1 + V x + 1 
(H) ( — ■ 

..... /* dx 

J Vx+ Vx 



/dx 
(The substitution w = ^ leads to an integral requir- 
V 1 + ^ ing yet anot her substitution; this is all right, but 
both substitutions can be done at once.) 

« /it 



tan # 

dx 



(Another place where one substitution can be 



1 made to do the work of two.) 

4* + 1 



(vi) | 

(vii) f 
V J J 2 X + 1 

(viii) y *V»</*. 

/>/ 1 — # 
^= dx. (In this case two successive substitutions work out 
1 — Vx best; there are two obvious candidates for the first 
substitution, and either will work.) 



*(x) [J*Z±.Ldx. 
J v * + 1 * 2 



The previous problem provided gratis a haphazard selection of rational 
functions to be integrated. Here is a more systematic selection. 



(i) f ^ + 7,-1 A , 
y # 3 + x 2 — x — 1 

( ii) f *±i — *. 

W J x* - 3x 2 + 3x - 1 



r x 3 4. 7^.2 _ c„ , 

v ' J (*- i)\ x + - - 



(iv) / 

, /• AT + 4 

(v) Jx^Ti 



x 3 + 7x* - 5x + 5 
1) 

2* 2 + x + 1 



(* + 3)(* - l) 2 
4 *. 



dx. 
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(V ° J x * + 2x >+l dx - 
(vii) J 



3x 2 + 3* + 1 



* 3 + 2x 2 + Ix + 1 



( ix ) y — , = — 



2x_ 

(x 2 + x + l) 2 * 



«. / ( , 2+ 3 ; +1) 3^ 

*7. Potpourri. (No holds barred.) The following integrations involve all the 
methods of the previous problems. 



arctan x . 

ax. 

1 + * 2 

arctan x 



» / 

r*i /" — 

w ; 

(iii) J log Vl + dx. 

(iv) y * log y/\ + * 2 

(v) 

(vi) y arcsin dx. 

(vii) f ■ * dx. 
J 1 + sin x 



x cos* at — sin X . 

•am x . __ _ fa m 



COS^ X 



(viii) J> 

(ix) ^" Vtan a: dx. 

/dx 
(To factor x 6 + 1, first factor y* + 1, using Problem 
* 6+1 14.) 

8. If you have done Problem 1 7-7, the integrals (ii) and (iii) in Problem 4 will 
look very familiar. In general, the substitution x — cosh u often works 
for integrals involving — 1 , while x — sinh u is the thing to try for 
integrals involving V# 2 + 1 . Try these substitutions on the other inte- 
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grals in Problem 4. (The method is not really recommended; it is easier 
to stick with trigonometric substitutions.) 

*9. The world's sneakiest substitution is undoubtedly 

x 

t — tan — ' x = 2 arctan L 
2 

2 

dx = dt. 

1 + t 2 

As we found in Problem 15-16, this substitution leads to the expressions 

2t 1 - t 2 

™ X = TT?' cosx = TT7 2 

This substitution thus transforms any integral which involves only sin 
and cos, combined by addition, multiplication, and division, into the 
integral of a rational function. Find 

(j) f (Compare your answer with Problem l(viii).) 

J 1 + sin x 

(ii) f *L (i n this case it is better to let t = tan x. Why?) 

J 1 — sin 2 x 

(iii) f — (There is also another way to do this, using 

J a sin x + b cos x p roblem 15 . 7> ) 

(iv) / sin 2 x dx. (An exercise to convince you that this substitution 
* should be used only as a last resort.) 

( v ) f — — (A last resort.) 

W J 3 + 5 sin x 

*10. Derive the formula for J sec x dx in the following two ways: 
(a) By writing 

1 cos x 



cos x 
1 — sin 2 x 



_ 1 [" cos X COS X ~1 

~ 2 Ll + sin x 1 — sin *J 



an expression obviously inspired by partial fraction decompositions. 
Be sure to note that f cos x/{\ - sin x) dx = - log(l - sin at); the 
minus sign is very important. And remember that % log a = log V a. 
From there on, keep doing algebra, and trust to luck. 



(b) By using the substitution t = tan x/2. Once again, quite a bit of 
manipulation is required to put the answer in the desired form; the 
expression tan x/2 can be attacked by using Problem 15-8, or both 
answers can be expressed in terms of t. There is another expression 
for / sec x dx, which is less cumbersome than log (sec x + tan x); 
using Problem 15-8, we obtain 

r f l+ tan t\ 

I sec x dx — log ( I 

J 

This last expression was actually the one first discovered, and was 
due, not to any mathematician's cleverness, but to a curious histori- 
cal accident: In 1599 Wright computed nautical tables that 
amounted to definite integrals of sec. When the first tables for the 
logarithms of tangents were produced, the correspondence between 
the two tables was immediately noticed (but remained unexplained 
until the invention of calculus). 

The derivation of je x sin x dx given in the text seems to prove that the 
only primitive of f(x) = e x sin x is F(x) = e x (sin x - cos x)/2, whereas 
F(x) = <? x (sin x — cos x)/2 + C is also a primitive for any number C. 
Where does C come from? (What is the meaning of the equation 

je x sin xdx = e x sin x — e x cos x — J> sin x dx?) 

(a) Find / arcsin x dx, using the same trick that worked for log and 
arctan. 

*(b) Generalize this trick: Find $f~ l (x) dx in terms of ff(x) dx. Compare 
with Problems 12-15 and 14-10. 

(a) Find / sin 4 x dx in two different ways: first using the reduction 
formula, and then using the formula for sin 2 x. 

(b) Combine your answers to obtain an impressive trigonometric 
identity. 

Express / log (log x) dx in terms of J (log x)~ l dx. (Neither is expressable 
in terms of elementary functions.) 
Express jx 2 e~ x2 dx in terms of je~ x2 dx. 

Prove that the function f(x) = e x /(e bx + e x + 1) has an elementary 
primitive. (Do not try to find it!) 

Prove the reduction formulas in the text. For the third one write 
f dx r dx f x 2 dx 

J (1 + X 2 ) n J (1 + *2)n-l J (1 + x *)n 

and work on the last integral. (Another possibility is to use the substitu- 
tion x = tan u.) 



= log(tang + ?)} 
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L 



18. Find a reduction formula for 

(a) fx n e°dx. 

(b) /(log x) n dx. 

*19. Prove that 

A /— , cosh x sinh x x 

Vt 2 - \dt = -■ 

i 2 2 

(See Problem 17-4 for the significance of this computation.) 

20. Prove that 

j h a f{x) dx = j h a f(a + b - x) dx. 

(A geometric interpretation makes this clear, but it is also a good exer- 
cise in the handling of limits of integration during a substitution.) 

21. Prove that the area of a circle of radius r is wr 2 . (Naturally you must 
remember that w is defined as the area of the unit circle.) 

22. Use induction and integration by parts to generalize Problem 14-6: 

/;(/;■(... (/>„)„,)...)„„. 

23. If /'is continuous on [a, b\ use integration by parts to prove theRiemann- 
Lebesgue Lemma for /: 

lim f 6 /(/) sin (X*) dt = 0. 

This result is just a special case of Problem 15-25, but it can be used to 
prove the general case (in much the same way that the Riemann- 
Lebesgue Lemma was derived in Problem 1 5-25 from the special case in 
which / is a step function). 

24. Prove the following version of integration by parts for improper integrals : 

P u'{x)v{x) dx = u(x)v(x) f — f 00 u(x)v'{x) dx. 

Ja |o ; fl 

The first symbol on the right side means, of course, 
lim u(x)v(x) — u(a)v(a). 

X—* 96 

*25. One of the most important functions in analysis is the gamma function, 

T( x ) = jj e-H*- 1 dt. 

(a) Prove that the improper integral T(x) is defined if x > 0. 

(b) Use integration by parts (more precisely, the improper integral 
version in the previous problem) to prove that 

I\* + 1) = xY{x). 

(c) Show that T(l) = 1, and conclude that I» = (n - 1)! for all 
natural numbers n. 
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The gamma function thus provides a simple example of a continuous 
function which ' 'interpolates" the values of n ! for natural numbers x. 
Of course there are infinitely many continuous functions / with 
f(n) = (n — 1 ) ! ; there are even infinitely many continuous func- 
tions / with f(x + 1) = xf(x) for all x > 0. However, the gamma 
function has the important additional property that log of is 
convex, a condition which expresses the extreme smoothness of 
this function, A beautiful theorem due to Harald Bohr and Johannes 
Molierup states that T is the only function / with log ° / convex, 
/(l) = 1 and f(x + 1) = x f(x). See the Suggested Reading for a 
reference. 

*26. (a) Use the reduction formula for J sin w x dx to show that 

/v/2 n — \ r^ 2 

/ sm n x dx = / sin n ~ 2 x dx. 

Jo n Jo 

(b) Now show that 



/2 sin^,^ = - 2 .i.^ 

o 3 5 7 In + 1 

T/2 . , n , x 1 3 5 2» - 1 
sin 2 " x <& = -•-•-•- , 

o 2 2 4 6 In 



and conclude that 

7r_2244 6 6 2n 2w /o" 72 sin2n * ^ 

2 1 3 3 5 5 7 2« - 1 * 2n + 1 ^Si^n+i ~ ^* 

(c) Show that the quotient of the two integrals in this expression is 
between 1 and 1 + l/2n, starting with the inequalities 

0 < sin 2n+1 x < sin 271 x < sin 271 " 1 x for 0 < x < tt/2. 

This result, which shows that the products 

2 2 4 U 6 2n 2n 

1 3 3 5*5*7 ' 2n - 1* 2n + 1 

can be made as close to ir/2 as desired, is usually written as an 
infinite product, known as Wallis 5 product: 

7T = 2 2 4 4 6 6 
2 r3*3*5*5 '7* 

(d) Show also that the products 

1 2 • 4 ; 6 • 2n 
\T n 1 • 3 • 5 • . . . • (2n - 1) 



can be made as close to Vx as desired. (This fact is used in the next 
problem and in Problem 26-18.) 
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27. It is an astonishing fact that improper integrals J q f(x) dx can often be 
computed in cases where ordinary integrals J a f(x) dx cannot. There is 
no elementary formula for j a e~ x * dx, but we can find the value of 
J J e~ x * dx precisely! There are many ways of evaluating this integral, 
but most require some advanced techniques; the following method 
involves a fair amount of work, but no facts that you do not already 
know. 



(a) Show that 



i 



i ,24 In 

(1 = — —7' 

o 3 5 2n + 1 

1 7T 1 3 2n - 

■ dx 



(1 + x 2 ) 71 2 2 4 2n - 2 



(This can be done using reduction formulas, or by appropriate 
substitutions, combined with the previous problem.) 

(b) Prove, using the derivative, that 

1 - x 2 < e~ x * for 0 < x < 1. 
1 

e~ xi < for 0 < x. 

~ 1 + x 2 

(c) Integrate the nth powers of these inequalities from 0 tol and from 0 
to oo , respectively. Then use the substitution y = V ' nx to show that 



Vn 



4 In 



3 5 2n + 1 

■\fn 



< j e~y* dy < / q e~y" dy 



<-Vn- 



3 2n - 3 



2 2 4 2n - 2 

(d) Now use Problem 26(c) to show that 

I rv dy - T- 

*28. (a) Use integration by parts to show that 

' sin .v , cos a cos b . f b cos x 



f b sin .v f cos a cos £ . P 
/ dx = — + / 

Ja X a 0 Ja 



X 2 



dx, 



and conclude that Jj (sin *)/* exists. (Use the left side to investi- 
gate the limit as a -» 0 + and the right side for the limit as b — > co .) 
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/ 



(b) Use Problem 15-31 to show that 
• sin (n + \)t 



i: 



dt = 7T 



for any natural number n. 
(c) Prove that 



lim 



sin(X + \)t 



sin 



dt = 0. 



Hint: The term in brackets is bounded by Problem 15-2(vi); the 
Riemann-Lebesgue Lemma then applies, 
(d) Use the substitution u = (X + %)t and part (b) to show that 



sin x _ 7T 

~ ~ X ~ 2 



Jo X 

*29. (a) Use the substitution u = t x to show that 



ro) = - r e-« l *dx. 
x Jo 



(b) Find 
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One of the most remarkable series of 
algebraic analysis is the following : 



m m(m — I) 



1 + - x + 



X' 



2 



1 1-2 



m(m - 1) ( m - 2) „. 



1-2-3 

m(m - 1) ■ • • [m - (n - 1)] 



+ 1-2 n 



+ 



when m is a positive whole number 

the sum of the series, 

which is then finite, can be expressed, 

as is known, by ( 1 + x) m . 

When m is not an integer, 

the series goes on to infinity, and it will 

converge or diverge according 

as the quantities 

m and % have this or that value. 

In this case, one writes the same equality 

(1 +x) m = 1 +™x 

m(rn — 1) 
+ - A jT2~ x + "' etc ' 

. . . It is assumed that 
the numerical equality will always occur 
whenever the series is convergent, but 
this has never yet been proved. 



NIELS HENRIK ABEL 



CHAPTER 



APPROXIMATION BY 
POLYNOMIAL FUNCTIONS 



There is one sense in which the "elementary functions" are not elementary 
at all. If p is a polynomial function, 

p{x) = <2 0 + aix + * • ' + a n x n , 
then p(x) can be computed easily for any number x. This is not at all true for 
functions like sin, log, or exp. At present, to find log x = J* 1/tdt approxi- 
mately, we must compute some upper or lower sums, and make certain that 
the error involved in accepting such a sum for log x is not too great. Com- 
puting e x — log" 1 (a:) would be even more difficult: we would have to com- 
pute log a for many values of a until we found a number a such that log a is 
approximately x — then a would be approximately e x . 

In this chapter we will obtain important theoretical results which reduce 
the computation of/(*), for many functions /, to the evaluation of polynomial 
functions. The method depends on finding polynomial functions which are 
close approximations to/. In order to guess a polynomial which is appropriate, 
it is useful to first examine polynomial functions themselves more thoroughly. 

Suppose that 

p(x) = a 0 + aix + ' • • + a n x n . 

It is interesting, and for our purposes very important, to note that the coeffi- 
cients en can be expressed in terms of the value of p and its various derivatives 
at 0. To begin with, note that 

p(0) = a,. 

Differentiating the original expression for p(x) yields 

p'(x) = a x + 2a 2 x + • • ' + na n x n '\ 

Therefore, 

P'(0) =/> (1) (0) =ai. 
Differentiating again we obtain 

V'(jr) = 2a 2 + 3 • 2 • a z x + • • • + n(n - 1) • a n x n "\ 
Therefore, 

^"(0) =/,< 2 >(0) = 2a+ | 

In general, we will have 

/><*>(0) = kla k or a k = ~jr' 

If wc agree to define 0! = 1, and recall the notation /> (0) = p, then this 

formula holds for k = 0 also. 
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If we had begun with a function p that was written as a "polynomial in 
(*-«)," 

p(x) = a 0 + ai(x -*)+'••+ a n (* - a) n , 
then a similar argument would show that 

P ik) (a) 
flt = — 

Suppose now that / is a function (not necessarily a polynomial) such that 

/<»(*), . . . ,/»>(«) 



all exist. Let 



a* = — — > 0 < k <n, 
k\ " 



and define 

The polynomial Pn.a is called the Taylor polynomial of degree n for / at a. 

(Strictly speaking, we should use an even more complicated expression, like 
Pn.aj, to indicate the dependence on /; at times this more precise notation 
will be useful.) The Taylor polynomial has been defined so that 

Pn/ k) (a) = f k) (a) for 0 < k < n; 

in fact, it is clearly the only polynomial of degree < n with this property. 

Although the coefficients of P n , a j seem to depend upon / in a fairly com- 
plicated way, the most important elementary functions have extremely simple 
Taylor polynomials. Consider first the function sin. We have 

sin(O) = 0, 

sin'(0) = cos 0 = 1, 

sin"(0) = - sin 0 = 0, 

sin"'(0) = - cos 0 = -1, 

sin (4) (0) = sin 0 = 0. 

From this point on, the derivatives repeat in a cycle of 4. The numbers 

sin ( *>(0) 

are 

11 11 

0, 1, 0, > 0, — , 0, > 0, — • • • • • 

31 5 ! 7! 9! 

Therefore the Taylor polynomial ftn+i.o of degree 2n + 1 for sin at 0 is 

Oct —I— i 

X 3 , X 5 X 1 



3! 5! 7! (2n + 1)1 

(Of course, P 2 »+i,o = iV^.o). 
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The Taylor polynomial P 2n ,o of degree In for cos at 0 is (the computations 
are left to you) 



x 2 , x 4 x 6 . , , mxm x 2n 



2! 4! 6! (2n)l 

The Taylor polynomial for exp is especially easy to compute. Since exp (fc) (0) 
= exp(O) = 1 for all k, the Taylor polynomial of degree n at 0 is 

y u3 yi4 

^.o(x) = 1+- + - + - + -+ • • * +^r- 

The Taylor polynomial for log must be computed at some point a 0, 
since log is not even defined at 0. The standard choice is a = 1. Then 

log'(l) = 1; 



in general 

log<*>(*) 



log'W = 


1 

—> 
X 


log"W = 


1 

X 2 


log"'W = 


2 

— , 


X 3 


(-l)*- 1 ^ - 


-1)! 


** 


1 



Therefore the Taylor polynomial of degree n for log at 1 is 

Pn.l(x) = (X ~ 1) — + + + " 

2 3 n 

It is often more convenient to consider the function f(x) — log(l + x). In 
this case we can choose a = 0. We have 

/<*>(*) = log (A) (l + *), 

so 

/<*>(0) = log<*>(l) = (-l)*-»(* - 0!. 
Therefore the Taylor polynomial of degree n for / at 0 is 

(-1)"-V 



/»„..(*) -*-- + — -+ ••• + 

2 3 4 /» 

There is one other elementary function whose Taylor polynomial is impor- 
tant — arctam The computations of the derivatives begin 

arctan'O) = — - — > arctan'(O) = 1; 
1 + x 2 

arctan"(*) = / ~ 2 * > arctan"(0) = 0; 
(1 + # 2 ) 2 

x (1 + * 2 ) 2 * (-2) +2* -2(1 +*5_v2* , „„ m 9 

arctan"'(*) = — - — -f — > arctan'"(0) = — 2. 

(1 + * 2 ) 4 
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It is clear that this brute force computation will never do. However, the 
Taylor polynomials of arctan will be easy to find after we have examined the 
properties of Taylor polynomials more closely — although the Taylor poly- 
nomial P n ,a,/ was simply defined so as to have the same first n derivatives at 
a as /, the connection between / and P n , a j will actually turn out to be much 
deeper. 

One line of evidence for a closer connection between / and the Taylor poly- 
nomials for / may be uncovered by examining the Taylor polynomial of 
degree 1, which is 

*..(*)-/(«)+/(«)(*-«). 

Notice that 

/(*) - PUx) = /(*) -f(a) _ 



Now, by the definition of f(a) we have 




FIGURE 1 



In other words, as x approaches a the difference /(*) — Pi, a (x) not only 
becomes small, but actually becomes small even compared to x — a. Figure 1 
illustrates the graph of f(x) — e x and of 

Pi.oM =/(0) +f(P)x =l+x, 

which is the Taylor polynomial of degree 1 for / at 0. The diagram also shows 
the graph of 

*..(*) = /(0) + /'(0) + ^ x* = 1+ x + £ 

which is the Taylor polynomial of degree 2 for / at 0. As x approaches 0, the 
difference f(x) — i\o(*) seems to be getting small even faster than the 
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difference f(x) — Pi,o(x). As it stands, this assertion is not very precise, but 
we are now prepared to give it a definite meaning. We have just noted that 
in general 

i im ^M = o. 

x—ki x — a 

For f(x) = e x and a = 0 this means that 

lim /w-A,w = lim g --i-, = Q- 



On the other hand, an easy double application of PHopital's Rule shows 
that 

i im eX Z 1 " * = j ± o. 

z->o a: 2 

Thus, although /(#) — Pi.oW becomes small compared to x, as x approaches 
0, it does not become small compared to x 2 . For ft.oW the situation is quite 
different; the extra term x 2 /2 provides just the right compensation: 

e x — 1 — x 

2 e x — 1 — x 
lim = lim 

a?->0 X 2 x-+0 2X 

e x — 1 

= lim = 0. 

x— o 2 

This result holds in general — if f{a) and f'{a) exist, then 

lim = 0; 

in fact, the analogous assertion for P n>a is also true. 



THEOREM l Suppose that / is a function for which 

/'M, . . . ,/->(«) 



all exist. Let 



f {k) (a) 

a k = — 7i ' 0 < A < n, 
k\ 



and define 

^n t aW = a 0 + ai(x — a) + ' ' ' + a n {x — a) n . 

Then 

lim^j ~ ^-W = 0. 
*->a (x — a) n 
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PROOF Writing out P n ,a( x ) explicitly, we obtain 

zoo - pu*) = h i - / <w) («) , 

(x - a) n (x - a) n n\ 

It will help to introduce the new functions 

n-l 

Q(x) = Z^tp (* - «)' and *W = ( * ~ 



lim /W - QW _ / <n) («) . 



and 



now we must prove that 

g(x) n\ 
Notice that 

Q(«( a ) = /<*>(«), k < n - 1, 
£<»(*) = n!(* - *)"-*/(» -A)!. 

Thus 

lim [/(*) - Q(*)] = /(«) - Q(«) = 0, 

X— >fl 

lim [/'(*) - Q'(*)] = /'(*) - Q'OO = o, 

lim [/ (B - 2) W - Q<»- 2) (*)] = /<"- J) (a) - Q (n - 2) (a) = 0, 

2 

limgW = lim*'(*) = • • • = lim£ ( "- 2) (*) = 0. 

x— ►<* x—*a x—*a 

We may therefore apply THopitaPs Rule n - 1 times to obtain 

lim /(*) - Q(«) _ L / (n - 1} M - Q^W . 

Since Q is a polynomial of degree n - 1, its (n - l)st derivative is a constant; 
in fact, = / (n " 1) (^). Thus 

x-^a (x - a) n x-~*a n\(x - a) 
and this last limit is f n) (a)/nl by definition of f n) (a). | 

One simple consequence of Theorem 1 allows us to perfect the test for local 
maxima and minima which was developed in Chapter 11. If a is a critical 
point of /, then, according to Theorem 11-5, the function / has a local mini- 
mum at a if f"{a) > 0, and a local maximum at a if/" (a) < 0. If/" (a) = 0 no 
conclusion was possible, but it is conceivable that the sign of/ 7 " (a) might give 
further information; and if f"(a) - 0, then the sign of/ (4) (a) might be signifi- 
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cant. Even more generally, we can ask what happens when 

(*) /'(«) =/» = • • • (a) =0, 

f n) (a) * 0. 

The situation in this case can be guessed by examining the functions 

f(x) - (* - «)• 
*(*) = -(*-«)", 

which satisfy (*). Notice (Figure 2) that if « is odd, then a is neither a local 
maximum nor a local minimum point for / or g. On the other hand, if n is 
even, then /, with a positive nth derivative, has a local minimum at a, while g, 
with a negative wth derivative, has a local maximum at a. Of all functions 
satisfying (*), these are about the simplest available; nevertheless they indicate 
the general situation exactly. In fact, the whole point of the next proof is that 
any function satisfying (*) looks very much like one of these functions, in a 
sense that is made precise by Theorem 1 . 

Suppose that 

f(a) = • • ■ = 0, 

f n) (a) * 0. 

(1) If n is even and f (n) (a) > 0, then / has a local minimum at a. 

(2) If n is even and f (n) (a) < 0, then / has a local maximum at a. 

(3) If n is odd, then / has neither a local maximum or minimum at a. 

There is clearly no loss of generality in assuming that f(a) = 0, since neither 
the hypotheses nor the conclusion are affected if / is replaced by / — f(a). 
Then, since the first n — 1 derivatives of / at a are 0, the Taylor polynomial 
P n>a of / is 

PnM) = f(a) (X -«)+•■ • (x _ a) n 

1 ! n\ 



f (n) (a) 



Thus, Theorem 1 states that 

/M - />„.„(*) _ 1: _ r /« f n) ( 



0 = lim J 



—a L(* - a) n nl J 



(# — a) n *-»a L(* — fl) 
Consequently, if x is sufficiently close to a, then 

/(*) f (n) (a) 

— has the same sign as 7 

(x - a)* n! 

Suppose now that n is even. In this case (x — a) n > 0 for all x a. Since 
f(x)/(x — a) n has the same sign as f (n) (a)/n\ for x sufficiently close to a, it 
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(c) 

FIGURE 3 



THEOREM 3 



PROOF 



follows that f(x) itself has the same sign as f n (a)/n \ for x sufficiently close to 
a. lif n) {a) > 0, this means that 

f(x) > 0 = f(a) 

for x close to a. Consequently, / has a local minimum at a. A similar proof 
works for the case f (n) (a) < 0. 

Now suppose that n is odd. The same argument as before shows that if xis 
sufficiently close to a, then 

/(*) u u 
— always has the same sign. 

(x - a) n 

But (x - a) n > 0 for x > a and (x - a) n < 0 for x < a. Therefore f(x) has 
different signs for x > a and x < a. This proves that / has neither a local maxi- 
mum nor a local minimum at a. \ 

Although Theorem 2 will settle the question of local maxima and minima 
for just about any function which arises in practice, it does have some theo- 
retical limitations, because f (k) (a) may be 0 for all k. This happens (Figure 
3(a)) for the function 

K ) \ 0, x = 0, 

which has a minimum at 0, and also for the negative of this function (Figure 
3(b)), which has a maximum at 0. Moreover (Figure 3(c)), if 

/(*) - Jo, x = 0 

{ -e~ l i x \ x < 0, 

then f (k) (0) = 0 for all k, but / has neither a local minimum nor a local 
maximum at 0. 

The conclusion of Theorem 1 is often expressed in terms of an important 
concept of "order of equality." Two functions / and g are equal up to order n 
at a if 

lhn^-y = 0. 

x~+a (x — a) n 

In the language of this definition, Theorem 1 says that the Taylor polynomial 
Pn.aj equals / up to order n at a. The Taylor polynomial might very well have 
been designed to make this fact true, because there is at most one polynomial 
of degree < n with this property. This assertion is a consequence of the follow- 
ing elementary theorem. 

Let P and Q be two polynomials in (x — a), of degree < n, and suppose that 
P and Q are equal up to order n at a. Then P = Q. 

Let R = P — Q. Since R is a polynomial of degree < n, it is only necessary to 
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COROLLARY 



PROOF 



prove that if 
satisfies 



R(x) = b 0 + 



+ b n (x - a)" 



R(x) 



x^a (x — a) n 

then R — 0. Now the hypotheses on R surely imply that 

lim / R W . = 0 for 0 < i < n. 

x-* a (x — ay 

For 2 = 0 this condition reads simply lim R(x) = 0; on the other hand, 

x — *a 

\imR(x) = lim [b 0 + bi(x -«)+••• + - <0 n ] 

x— >a x— *a 

= 6„. 



Thus b 0 = 0 and 
Therefore, 



/?(*) = 4i(* -«)+■• 
= *i + * 2 (* - a) + 



• • + b n (x - a) n ~ l 



and 



X— >a at — a 



Thus #i = 0 and 

*(*) = b 2 ( x - a y+ • 

Continuing in this way, we find that 



Let / be rc- times differentiable at a, and suppose that P is a polynomial in 
(x — a) of degree < n, which equals / up to order n at a. Then P = P n , 0 . 

Since P and P n , a both equal / up to order n at a, it is easy to see that P equals 
P nta up to order n at a. Consequently, P = P n , a by the Theorem. | 

At first sight this corollary appears to have unnecessarily complicated 
hypotheses; it might seem that the existence of the polynomial P would auto- 
matically imply that /is sufficiently differentiable for P n , a to exist. But in fact 
this is not so. For example (Figure 4), suppose that 



s( \ _ { * n+ \ x irrational 
J 10, x rational. 



If P(x) = 0, then P is certainly a polynomial of degree < n which equals / up 
to order n at 0. On the other hand, f(a) does not exist for any a 7± 0, so /"(0) 
is undefined. 
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V +1 , x irrational 
0, x rational 



FIGURE 4 



When / does have n derivatives at a, however, the corollary may provide a 
useful method for finding the Taylor polynomial of /. In particular, remember 
that our first attempt to find the Taylor polynomial for arctan ended in failure. 
The equation 



arctan x = / dt 

Jo 1 + t 2 

suggests a promising method of finding a polynomial close to arctan — divide 
1 by 1 + t 2 , to obtain a polynomial plus a remainder: 

This formula, which can be checked easily by multiplying both sides by 1 + t 2 , 
shows that 



f x fx f2n+2 

= / 1 + . • • + (-1)V»*+ / 1 dt 

J° JO 1 + t 2 

y 2n+I fx f 2n+2 

■ ■ ■ +(- 1 )"^xr + (-i) n+1 / hrrt*- 

2n + 1 Jo 1 + t 2 



3 + 5 

According to our corollary, the polynomial which appears here will be the 
Taylor polynomial of degree In + 1 for arctan at 0, provided that 



Jo 1 + t' 2 



^2n+2 

2 dt 



lim — = 0. 

X-+Q X 2n+1 



Since 



rx ^2w+2 r x 

7o i + / 2 y 0 



2/z + 3 



this is clearly true. Thus we have found that the Taylor polynomial of degree 
2n + 1 for arctan at 0 is 

X 3 X h ~2n+l 

ft«+uW =*-- + --■-•+ (-1)" 



3 5 2n + 1 
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By the way, now that we have discovered the Taylor polynomials of arctan, it 
is possible to work backwards and find arctan a) (0) for all k: Since 



w *) = *-- + I -... +( -ir 2n + i . 

and since this polynomial is, by definition, 

arctan-(O) + arctan-(O), + * + ■ ■ ■ + ^ 

2 ! (2/2 + 1 ) ! 

we can find arctan a) (0) by simply equating the coefficients of x k in these two 
polynomials : 

arctan a) (0) . .... 

= 0 if k is even, 

k\ 

arctan ( » +1) ( 0) = (^}Y or arctan <« +l > (0) = . (2 /)|. 

(2/+ 1)! 21+1 

A much more interesting fact emerges if we go back to the original equation 

y 3 y 5 y 2n-fl fx t 2n+2 

— * - « - T + ? - ■ ■ • + 27+T + ( - ,r+I /. 



and remember the estimate 

^2n f 2 



o 1 + 



dt 



2n + 3 



When |#| < 1, this expression is at most 1/(2h + 3), and we can make this 
as small as we like simply by choosing n large enough. In other words, for 
|*| < 1 we can use the Taylor polynomials for arctan to compute arctan x as accurately 
as we like. The most important theorems about Taylor polynomials extend this 
isolated result to other functions, and the Taylor polynomials will soon play 
quite a new role. The theorems proved so far have always examined the 
behavior of the Taylor polynomial P n , a for fixed n, as x approaches a. Hence- 
forth we will compare Taylor polynomials P nia for fixed x, and different n. In 
anticipation of the coming theorem we introduce some new notation. 

If / is a function for which P n , a (x) exists, we define the remainder term 
Rn t a{x) by 

/(*) - P n ,a(x) + Pn.a& 

= /GO +/'(«)(* -*)+•••+ ^-7^ (* ~ *) n + RnA*). 

n I 

We would like to have an expression for R n>a (x) whose size is easy to estimate. 
There is such an expression, involving an integral, just as in the case for arctan. 
One way to guess this expression is to begin with the case n = 0: 

/(*) «/(n) +RM- 
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The Fundamental Theorem of Calculus enables us to write 

/w =/oo + j'mdt, 

so that 

AuM = j x a f(t)dt. 

A similar expression for Ri, a {x) can be derived from this formula using inte- 
gration by parts in a rather tricky way: Let 

"(0 = f(t) and v(t) — t — x 

(notice that x represents some fixed number in the expression for v(t), so 
v'(t) = 1); then 

( X f (t)dt= P/'M-l dt 
I i 
u(t) v'(t) 

= u(t)v(t)\* - r f f {t){t-x) dt. 

u'(t) v(t) 

Since v(x) = 0, we obtain 

/w = /(«) + j'mdt 

= /(«) - «(«>(«) + /; /"W(* - o * 

= f(a) +f'(a)(x -a) + f' /"«(* - t) dt. 

Thus 

RU*) = f a * f"(t)(x - t) dt. 

It is hard to give any motivation for choosing v(t) = t — x, rather than 
v(t) = t. It just happens to be the choice which works out, the sort of thing one 
might discover after sufficiently many similar but futile manipulations. How- 
ever, it is now easy to guess the formula for R 2ta (x). If 

u (t) = f"(t) and v(t) = ~ ( * - ^\ 



then v'(t) — (x — t), so 



r f"(tKx - 1) dt = u(t)v(t)\ x - r r 

Ja \a Ja 



~(x-t) 



'(0 • — dt 



This shows that 

./«>(/) 



-/'(«)('-«>' + r^ {x -tyd, 

2 J a 2 

(x - O 2 ^- 



2 

You should now have little difficulty giving a rigorous proof, by induction, 
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that if f (n+1) is continuous on [a, x], then 

*»..(*) = / ^—t^ (* " 0" dt. 

From this formula, which is called the integral form of the remainder, it is 
possible (Problem 13) to derive two other important expressions for /?„,«(*): 
the Cauchy form of the remainder, 

R n aix) = - (* - t) n (x - a) for some t in (a, *), 

n\ 

and the Lagrange form of the remainder, 

f(n+l)(A 

Rn,a(*) = 7 i A 1 (* - f ° r SOme 1 in 

In the proof of the next theorem (Taylor's Theorem) we will derive all three 
forms of the remainder in an entirely different way. One virtue of this proof 
(aside from its cleverness) is the fact that the Cauchy and Lagrange forms of 
the remainder will be proved without assuming the extra hypothesis that 
/ (n+1) is continuous. In this way Taylor's Theorem appears as a direct general- 
ization of the Mean Value Theorem, to which it reduces for n = 0, and which 
is the crucial tool used in the proof. 

These remarks may suggest a strategy for proving Taylor's Theorem. 
Since R n , a (a) = 0, we might try to apply the Mean Value Theorem to the 
expression 

x — a x — a 

On second thought, however, this idea does not look very promising, since it 
is not at all clear how / (n+1) (f) is ever going to be involved in the answer. 
Indeed, if we take the most straightforward route, and differentiate both sides 
of the equation which defines R n>a , we obtain 

/'(*) = f(a) +f"(a)(x -*)+•••+ (* - a)*" 1 + /?„«'(*), 

which is useless. The proper application of the Mean Value Theorem has a 
lot in common with the integration by parts proof outlined above. This proof 
involved the derivative of a function in which x denoted a number which was fixed. 
This is just how x will be treated in the following proof. 

THEOREM 4 (TAYLOR'S theorem) Suppose that /',..., / (n+1) are defined on [a, x\ and that R n , a (x) is denned 

by 

/(*) = f( a ) + f( a )(x _«)+...+ (x - aY + R n ,a( x )- 
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Then 

/(»+i> ft) 

(1) Rn,aW = , (x - /) n (* ~ a) for some / in (a, x). 

f (n+1) (t) 

(2) R nta (x) = ; ;/ t (* - a) n+1 for some / in (a, x). 

\n -+- 1 J ! 

Moreover, if /< n+1) is integrable on [a, at], then 
/•<»+!) (V) 

(3) /?„..(*) = / I A. 

./aft! 

(If a: < a, then the hypothesis should state that /is (n + 1 ) -times differentiable 
on [x, a]; the number / in (1) and (2) will then be in (x, a)> while (3) will 
remain true as stated, provided that / (n+1) is integrable on [x, a].) 



PROOF For each number t in [a, x] we have 

/(*) = fit) +f(t)(x - t) + • • • + ^ (x - 0" + HA*)- 

Let us denote the number R Htt (x) by S(t); the function 6" is defined on [a, x], 
and we have 

(*) fix) = fit) +f'(t)(x - 0 + ' • • + (* - 0 n + J(0 

for all t in [a, *]. 

We will now differentiate both sides of this equation, which asserts that the 
function whose value at t is /(#), equals the function whose value at t is 

f {n) (t) 

f(0 + • ■ • + ^— y (* - ty + sit). 

(In common parlance we are considering both sides of (*) "as a function of /.") 
Just to make sure that the letter x causes no confusion, notice that if 

git) = /(*) for all t, 

then 

g'it) = 0 for all t; 

and if 

f (k) (t) 

then 

g'it) =l-Mk{x- ty-\-\) + L_w (x _ t) k 



f {k) (t) f (k+i) (t) 

-J w_ r x _ t \k-i _i_ Z \ll r x _ rt* 
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Applying these formulas to each term of (*), we obtain 

0 = f'{i) + [-f(t) + (x - 0] + [=£@ {x-t)+^(x- 0 2 ] 

+ • • • + C* - 0- 1 + ^ <* - 0-] + S'(t). 

In this beautiful formula practically eveything in sight cancels out, and we 
obtain 

S>( t ) = - I -ifi ( X - t )\ 

n\ 

Now we can apply the Mean Value Theorem to the function S on [a, x] : there 
is some / in (a, x) such that 

™ ~ s(a) = S'(t) - - ^ (x - o-. 

at — <2 n! 

Remember that 

S(t) = *„,,(*); 

this means in particular that 

S(x) = R n , x (x) = 0, 
J(a) = R„,«(x). 

Thus 

o-i M W . / <n+1) W 



x — a 

or 



Rn,*(*) = f —-^-(x-tnx--a); 

this is the Cauchy form of the remainder. 

To derive the Lagrange form we apply the Cauchy Mean Value Theorem 
to the functions S and g(t) = (x — t) n + l : there is some t in {a, x) such that 

/ (n+l) w . _. t)n 

S(x) - S(a) S'(t) n\ K 



Thus 



or 



g(*)-g(a) g'(t) + 

*...(*) = / (n+1) (0 
(x - a) n+1 (n+1)! 



which is the Lagrange form. 
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Finally, if is integrable on [a, x], then 

fx fx f(*+i)(A 
S(x) - S(a) = / S'(t) = - / I ^ (x - t) n dt 

Ja Ja 7l\ 



or 

Cx /(n+i)/ 



fx /(n+i) / f\ 

Rn,a(*) = / 7 : ~ (x - t) n dt. | 

Ja n\ 



Although the Lagrange and Cauchy forms of the remainder are more than 
theoretical curiosities (see, e.g., Problem 22-16), the integral form of the 
remainder will usually be quite adequate. If this form is applied to the func- 
tions sin, cos, and exp, with a = 0, Taylor's Theorem yields the following 
formulas: 

sin * = * - — + — - • • • + (-l) n - 



3! 5! v ' {In + 1)! 

.»(2n+2) 

+ 



Jo (2« + l)! 1 



X 2 X* X 2n fi cos (»+DM 

cos x = 1 - - + --•••+ (-1)" — + / — (x - t) 2n dt, 

2! 4! k ; (2n)\ Jo (2n) ! 

y.2 ^.n /*x 

** = 1 +* + -+...+ ?L +/ .L (*_,)» 

To evaluate any of these integrals explicitly would be supreme foolishness — 
the answer of course will be exactly the difference of the left side and all the 
other terms on the right side ! To estimate these integrals, however, is both easy 
and worthwhile. 

The first two integrals are especially easy. Since 

| sin (2n+2) W | < ! for aU t} 

we have 

f oTn? (x ~ t)2n+1 dt * ?^4lTT I f (x ~ <)2 " +1 dt 

Jo (2n + l)\ {2n + l)\\Jo 

Since 

-(x - t) 2n+2 \ t=sx 



( x -ty n+i dt = 

o 2n + 2 <-o 



2rc + 2 

we conclude that 



/; 



Jo (2« + l)! 
Similarly, we can show that 

fx coS (2n+1) (/) 



S in (2n+2) (Y) 



< 



(2,)! {X -V ndt 



(2« + 2)! 



(2n + l)! 
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These estimates are particularly interesting, because (as proved in Chapter 16) 
for any £ > 0 we can make 

x n 

1 < 8 
n\ 

by choosing n large enough (how large n must be will depend on x). This 
enables us to compute sin x to any degree of accuracy desired simply by 
evaluating the proper Taylor polynomial P n ,o(x). For example, suppose we 
wish to compute sin 2 with an error of less than 10~~ 4 . Since 

22n+2 

sin 2 - / 5 2n+i,o(2) + R, where \R\ < — - - - > 
we can use P 2 n+i,o(2) as our answer, provided that 

22n+2 



(2n + 2)\ 



< 1(T 4 . 



A number n with this property can be found by a straightforward search — 
it obviously helps to have a table of values for n ! and 2 n (see page 356) . In this 
case it happens that n — 5 works, so that 

sin 2 = i>n,o(2) + R 

3! 5! 7! 9! 11! 
where \R\ < 10~ 4 . 

It is even easier to calculate sin 1 approximately, since 

1 



sin 1 = P 2n +i,o(l) + R, where \R\ < 



(2n + 2)\ 

To obtain an error less than e we need only find an n such that 

_1 

(2rc + 2)! < £? 

and this requires only a brief glance at a table of factorials. (Moreover, the 
individual terms of P 2n +i,o(l) will be easier to handle.) 

For very small x the estimates will be even easier. For example, 

. 1 , lnt . 1 

sin - 



P2n+M (l^) + *' where|i?l < 



10 + ' \10/ ' ' 1 10 2 " +2 (2/2 + 2)! 

To obtain \R\ < 10~ 10 we can clearly take n = 4 (and we could even get away 
with n = 3). These methods are actually used to compute tables of sin and 
cos. A high-speed computer can compute P 2 n+i,o(*) for many different x in 
almost no time at all. 

Estimating the remainder for e* is only slightly harder. For simplicity 
assume that x > 0 (the estimates for x < 0 are obtained in Problem 9). On 
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the interval [0, x] the maximum value of e l is since exp is increasing, so 

fx p t pX r x p X Y n + X 

/ e -{x-tYdt<^- (»_,)- A 

Jo nl n\ Jo (n + 1) ! 

Since we already know that * < 4, we have 

e x x n+l 4 x x n+l 
< 



(« + !)! (n + 1)! 

which can be made as small as desired by choosing n sufficiently large. How 
large n must be will depend on x (and the factor 4 X will make things more 
difficult). Once again, the estimates are easier for small x. If 0 < x < 1, then 

x 2 , x n 



e x =l+x + -+ •••+- + /?, where 0 < R < 



2! nl 9 (n + 1)! 

(The inequality 0 < R follows immediately from the integral form for R.) 
In particular, if n = 4, then 

0<R< h < h 

so 

^ = ^1=1 + 1+1+1 + 1 + ^ where 0 < R < ^~ 
2! 3! 4! 5 10 

65 

= Ya + r 

-l + '-l + R, 
24 ' 

which shows that 

2 < e < 3. 

(This allows us to improve our estimate of R slightly: 

3 * x n+i x 

By taking « = 7 you can compute that the first 3 decimals for e are 

* = 2.718 . . . 

(you should check that n = 7 does give this degree of accuracy, but it would 
be cruel to insist that you actually do the computations) . 

The function arctan is also important but, as you may recall, an expression 
for arctan a) (*) is hopelessly complicated, so that the integral form of the 
remainder is useless. On the other hand, our derivation of the Taylor poly- 
nomial for arctan automatically provided a formula for the remainder: 

x* , , (~l)V> n+1 , p(-l)"+^+ 2 

arctan x = x --+'•' + — — h / TT~^ dL 

3 2n + 1 Jo 1 + t 2 
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As we have already estimated, 



1 + t* 



dt 



! j 









2n + 3 



For the moment we will consider only numbers x with \x\ < 1. In this case, 
the remainder term can clearly be made as small as desired by choosing n 
sufficiently large. In particular, 

1 1 ( — \} n 1 

arctan 1 = 1- - + -- -- -+ ±~ J- + R, where \R\ < 



3 5 In + 1 2n + 3 

With this estimate it is easy to find an n which will make the remainder less 
than any preassigned number; on the other hand, n will usually have to be so 
large as to make computations hopelessly long. To obtain a remainder 
<10~ 4 , for example, we must take n > (10 4 - 3)/2. This is really a shame, 
because arctan 1 = tt/4, so the Taylor polynomial for arctan should allow us 
to compute t. Fortunately, there are some clever tricks which enable us to 
surmount these difficulties. Since 

l**+x..(*)| < 

much smaller w's will work for only somewhat smaller #'s. The trick for com- 
puting 7r is to express arctan 1 in terms of arctan x for smaller x; Problem 5 
shows how this can be done in a convenient way. 

The Taylor polynomial for the function f(x) = log (a: + 1) at a = 1 is best 
handled in the same manner as the Taylor polynomial for arctan. Although 
the integral form of the remainder for / is not hard to write down, it is difficult 
to estimate. On the other hand, we obtain a simple formula if we begin with 
the equation 

' = 1 - t + t* ~ • * ' + (-l)"- 1 *"- 1 + ^ } * 



\+t 1 + t 

this implies that 

1 y 2 jr 3 x n 

1 ^ ,+ ' ) = /.r^'*-'-i + i--" +( - 1) ""v 



fx t n 



for all x > -1. If x > 0, then 



fx fn fx y n ^~l 

/ -=—dt < t n dt = — — 
Jo t + 1 Jo n + \ 



and there is a slightly more complicated estimate when — 1 < x < 0 (Problem 
10). For this function the remainder term can be made as small as desired by 
choosing n sufficiently large, provided that — 1 < x < 1 . 
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The behavior of the remainder terms for arc tan and f(x) = \og(x + 1) is 
quite another matter when |*| > 1. In this case, the estimates 

Ui 2n+3 

|#2n+i,o0)| < - — — for arctan, 
2n + 3 

l*».o(*)| < -^7 (*>0)for/, 
n + 1 

are of no use, because when \x\ > 1 the bounds x m /m become large as m 
becomes large. This predicament is unavoidable, and is not just a deficiency 
of our estimates. It is easy to get estimates in the other direction which show 
that the remainders actually do remain large. To obtain such an estimate for 
arctan, note that if t is in [0, x] (or in [x, 0] if x < 0), then 

1 + t 2 < 1 +x 2 < 2x\ if |*| > 1, 

so 



1 fx *2n+2 

\ dt 


> ± \l 




fX t 2n + 2 dt 


1 Jo 1 + t 2 


~ 2x 2 \J 





4n + 6 



Similarly, if x > 0, then for t in [0, x] we have 

1 + t < 1 + x < 2x, if x > 1, 



so 



fx t n i fx 

/ dt > - / r dt = 

Jo t + 1 2x Jo 



2n + 2 



These estimates show that if \x\ > 1, then the remainder terms become large 
as n becomes large. In other words, for \x\ > 1, the Taylor polynomials for 
arctan and / are of no use whatsoever in computing arctan x and log(x + 1). This is 
no tragedy, because the values of these functions can be found for any x once 
they are known for all x with |#| < 1. 

This same situation occurs in a spectacular way for the function 

We have already seen that f (k) (0) = 0 for every natural number k. This means 
that the Taylor polynomial P n , 0 for / is 

f"(0) f in) (0) 
Pn.oM =/(0)+/'(0)*+ 7 -^* 2 + • • ■ + J -^x» 

Z ! 72 I 

= 0. 

In other words, the remainder term R n ,o(x) always equals f(x), and the Taylor 
polynomial is useless for computing /(*), except for x — 0. Eventually we will 
be able to offer some explanation for the behavior of this function, which is 
such a disconcerting illustration of the limitations of Taylor's Theorem. 

The word "compute 55 has been used so often in connection with our esti- 
mates for the remainder term, that the significance of Taylor's Theorem might 
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be misconstrued. It is true that Taylor's Theorem is an almost ideal computa- 
tional aid (despite its ignominious failure in the previous example), but it has 
equally important theoretical consequences. Most of these will be developed 
in succeeding chapters, but two proofs will illustrate some ways in which 
Taylor's Theorem may be used. The first illustration will be particularly 
impressive to those who have waded through the proof, in Chapter 16, that 
7r is irrational. 



THEOREM 5 e is irrational. 



PROOF We know that, for any n, 

e = el = 1 + h + h + " ' • + h + Rn > where 0 < *• < ottoi" 



Suppose that e were rational, say e = a/b, where a and b are positive integers. 
Choose n > b and also n > 3. Then 

so 

— = n\ + n\ + — + ' • • + — + n\Rn- 
b 2! n\ 

Every term in this equation other than n \R n is an integer (the left side is an 
integer because n > b). Consequently, n\R n must be an integer also. But 

3 

0 < R n < 



(n+l)\ 
so 

0 <n\R n <-^-<\<\, 
n + 1 4 

which is impossible for an integer. | 

The second illustration is merely a straightforward demonstration of a fact 
proved in Chapter 15: If 

/"+/=0, 
f(0) = o, 
/'(0) = o, 

then / = 0. To prove this, observe first that f k) exists for every k\ in fact 

f* = (/")' = -/'> 

/ (4) = (/ 3 )' =("/')' =-/"=/, 

/(5) = (/ (4))/ = ^ 

etc. 
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This shows, not only that all f k) exist, but also that there are at most 4 different 
ones: /, /', -/, -/'. Since /(0) = /'(0) = 0, all /<*>(()) are 0. Now Taylor's 
Theorem states, for any n, that 



fx f(n+D(A 

fix) = / f — (x - *)" dt. 
Jo nl 



Each function f {nJrl) is continuous (since f {n+2) exists), so for any particular x 
there is a number M such that 

|/ (n+1) (0l < M for 0 < * < x, and a// tz 

(we can add the phrase "and all n" because there are only four different f k) ). 
Thus 



\f(x)\ < Ml ['<*— 
\ Jo nl 



M\x\ 



n+l 



(»+ 1)1 



Since this is true for every rc, and since x n /n ! can be made as small as desired 
by choosing n sufficiently large, this shows that |/(*) | < s for any £ > 0; conse- 
quently, f(x) = 0. 

The other uses to which Taylor's Theorem will be put in succeeding chap- 
ters are closely related to the computational considerations which have con- 
cerned us for much of this chapter. If the remainder term R n , a ( x ) can be made 
as small as desired by choosing n sufficiently large, then f(x) can be computed 
to any degree of accuracy desired by using the polynomials P n ,a( x )- As we 
require greater and greater accuracy we must add on more and more terms. 
If we are willing to add up infinitely many terms (in theory at least!), then 
we ought to be able to ignore the remainder completely. There should be 
4 infinite sums" like 

x z , x 5 x 7 , 

sm x = x h * ' ' , 

3! 5! 7! 

X 2 , X 4 X 6 , x s 

COS x = 1 h • • • , 

2! 4! 6! 8! 

Y 2 Y Z v 4 

e* =\+x + -+-+-+ > • • , 
2! 3! 4! 

^5 ^7 

arctan x = x — — H h • • • if |*| < 1, 

3 5 7 

log(l + *) = x - X ^ + X 4 - ^ + • • • if -1< X < 1. 
z 3 4 

We are almost completely prepared for this step. Only one obstacle remains 
— we have never even defined an infinite sum. Chapters 21 and 22 contain the 
necessary definitions. 
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PROBLEMS 

1. Find the Taylor polynomials (of the indicated degree, and at the indi- 
cated point) for the following functions. 

(i) /(*) = e e '; degree 3, at 0. 

(ii) /(*) = e* in x degree 3, at 0. 

7T 

(iii) sin; degree 2n, at -• 

(iv) cos; degree 2n, at t. 

(v) exp; degree n, at 1. 

(vi) log; degree n, at 2. 

(vii) /(*) = x 6 + x 3 + x; degree 4, at 0. 

(viii) /(*) = x h + x z + x; degree 4, at 1. 

(ix) f(x) = ~^- 2 ; degree 2n + 1, at 0. 

(x) /(*) = 7^t~; degree n, at 0. 

x ~t~ -V 

2. Write each of the following polynomials in x as a polynomial in (x — 3). 
(It is only necessary to compute the Taylor polynomial at 3, of the same 
degree as the original polynomial. Why?) 

(i) x 2 - Ax - 9. 

(ii) x 4 - I2x* + 44a: 2 + 2x + 1. 

(iii) x\ 

(iv) ax 2 + bx + c. 

3. Write down a sum (using 2 notation) which equals each of the following 
numbers to within the specified accuracy. To minimize needless com- 
putation, consult the tables for 2 n and n \ on the next page. 

(i) sin 1; error < 1(T 17 . 

(ii) sin 2; error < 1(T 12 . 

(iii) sin J; error < 10~ 20 . 

(iv) e; error < 10 -4 . 

(v) e 2 ; error < 10" 5 . 



71 


Z 


• 


1 


2 


1 


2 


4 


2 


3 


8 


6 


4 


16 


24 


5 


32 


120 


6 


64 


720 


7 


128 


5,040 


8 


256 


40,320 


9 


512 


362,880 


10 


1,024 


3,628,800 


11 


2,048 


39,916,800 


12 


4,096 


479,001,600 


13 


8,192 


6,227,020,800 


14 


16,384 


87,178,291,200 


15 


32,768 


1,307,674,368,000 


16 


65,536 


20,922,789,888,000 


17 


131,072 


355,687,428,096,000 


18 


262,144 


6,402,373,705,728,000 


19 


524,288 


121,645,100,408,832,000 


20 


1,048,576 


2,432,902,008,176,640,000 



This problem is similar to the previous one, except that the errors 
demanded are so small that the tables cannot be used. You will have to 
do a little thinking, and in some cases it may be necessary to consult the 
proof, in Chapter 16, that x n /n ! can be made small by choosing n large — 
the proof actually provides a method for finding the appropriate n. In 
the previous problem it was possible to find rather short sums; in fact, it 
was possible to find the smallest n which makes the estimate of the 
remainder given by Taylor's Theorem less than the desired error. But in 
this problem finding any specific sum is a moral victory (provided you 
can demonstrate that the sum works). 

(i) sin 1; error < 10- (1 ° 10) . 

(ii) e; error < 10" 1>00 °. 

(iii) sin 10; error < 10~ 20 . 

(iv) e 10 ; error < 10~ 30 . 

(v) arctan toS error < 10~ (1 ° 10) . 

(a) Prove, using Problem 15-8, that 

7T 1 1 

- = arctan - + arctan -> 
4 2 3 

* A 1 1 

- = 4 arctan arctan — 

4 5 239 
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(b) Show that ir = 3.14159 . . . . (Every young man should verify a 
few decimals of ir for himself, but the purpose of this exercise is not 
to set you off on an immense calculation. If the second expression in 
part (a) is used, the first 5 decimals for ir can be computed with 
remarkably little work.) 
6. For every number a, and every nonnegative integer n, we define the 

"binomial coefficient" 

\n) n\ 
If a is not an integer, then (^j is never 0, and alternates in sign for 
n > a. Show that the Taylor polynomial of degree n for f(x) = (1 + x)« 

n 

at 0 is P rt ,oW = ^ (j^J x k , and that the Cauchy and Lagrange forms 

k = 0 

of the remainder are the following: 
Cauchy form: 
_ , N a(a — 1) • • • (a — n) , . m/A . 

RnAx) = — " i " — *(* - 0 n (l + tY n 1 

n ! 

a(a — 1) • • • (a — n) 



n ! 



'( 1 + ')-'(rr-;)" 



-(" + •>(,+ J** 1 + (rd)"' ' in [0 - or [*• 0I - 

Lagrange form: 

_ . . a(a — 1) * ■ • (a — n) „,., A , N „. 

Ai.oW = . 1N , * n+1 0 + 0° n 1 

(w+1)! 

'= ( n + J * n+1 d + ^ a_n_1 ' ' in [°' *1 or & 

Estimates for these remainder terms are rather difficult to handle, and 
are postponed to Problem 22-16. 
7. Suppose that ai and bi are the coefficients in the Taylor polynomials at 
a of / and g, respectively. In other words, ai = f {i) (a)/i\ and bi = 
g (i) (a)/i\. Find the coefficients a of the Taylor polynomials at a of the 
following functions, in terms of the afs and b/s. 

(0 f + g. 

(ii) fg. 

(iii) /'• 

(iv) h{x) = j'f{t)dt. 

(v) k(x) = J* f(t) dt. 
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*8. (a) Prove that the Taylor polynomial of f(x) = sin(# 2 ) of degree 
An + 1 at 0 is 



y 6 y 10 v 4n 



Hint: If P is the Taylor polynomial of degree 2n + 1 for sin at 0, 
then sin x = P(x) + R(x), where Km R(x)/x 2n+1 = 0. What does 

this imply about lim ^(Ar 2 )A 4n+1 ? 

(b) Find f ik) (0) for all A:. 

(c) In general, if f(x) = g(x n ), find f k) (0) in terms of the derivatives of 
gat 0. 

Prove that if x < 0, then 



7o « 



x 

- (x - t) n dt 



(n + l)\ 



10. Prove that if -1 < x < 0, then 



f. 



o I + t 



dt 



(\ +x)(n+ 1) 



*11. (a) Show that if \g f (x)\ < M\x - a\ n for \x - a\ < 8, then \g(x)\ < 
M\x - a\ n+1 /(n + 1) for \x - a\ < 8. 

(b) Use part (a) to show that if lim g r (x)/(x — a) n = 0, then 

x—*a 

lim g(x)/(x - a) n+l - 0. 

(c) Show that iig{x) =f(x) -P n , aJ (x),theng'(x) = f'(x) - P n -i,aAx). 

(d) Give an inductive proof of Theorem 1, without using PHopitaPs 
Rule. 

12. Deduce Theorem 1 as a corollary of Taylor's Theorem, with any form 
of the remainder. (The catch is that it will be necessary to assume one 
more derivative than in the hypotheses for Theorem 1.) 

13. Deduce the Cauchy and Lagrange forms of the remainder from the 
integral form, using Problems 13-27 and 13-28. There will be the same 
catch as in Problem 12. 

14. (a) Prove that if f f (a) exists, then 

f"(a) - Um- f(a + h)+ ^ ~ h) - W 



Hint: Use the Taylor polynomial of degree 2 with x = a + h and 
with x — a — h. 
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exists, even though /"(0) does not. 
15. Use the Taylor polynomial Pi, a ,/, together with the remainder, to prove 
a weak form of Theorem 2 of the Appendix to Chapter 11: If /" > 0, 
then the graph of / always lies above the tangent line of /, except at the 
point of contact. 

*16. Problem 17-32 presented a rather complicated proof that / — 0 if 
/" - / = 0 and /(0) = /'(0) = 0. Give another proof, using Taylor's 
Theorem. (This problem is really a preliminary skirmish before doing 
battle with the general case in Problem 1 7, and is meant to convince you 
that Taylor's Theorem is a good tool for tackling such problems, even 
though tricks work out more neatly for special cases.) 

! *17. Consider a function / which satisfies the differential equation 

/<»> = B f aj f«\ 

for certain numbers ao, . . . , a n -\. Several special cases have already 
received detailed treatment, either in the text or in other problems; in 
particular, we have found all functions satisfying /' = /, or /" + / = 0, 
or f"—f= 0. The trick in Problem 17-31 enables us to find many solu- 
tions for such equations, but doesn't say whether these are the only 
solutions. This requires a uniqueness result, which will be supplied by this 
problem. At the end you will find some (necessarily sketchy) remarks 
about the general solution. 

(a) Derive the following formula for / (n+1) (let us agree that will 
beO): 

n-1 

(b) Deduce a formula for y (n + 2) . 

The formula in part (b) is not going to be used; it was inserted only to 
convince you that a general formula for f n+k) is out of the question. On 
the other hand, as part (c) shows, it is not very hard to obtain estimates 
on the size of / (n+A:) (*). 

(c) Let N = max(l, |<2 0 |, . . . , \a n -i\). Then |<zy_i + tf n _i<z;| < 2N 2 ; 
this means that 

n-1 

= £ bffi$\ where |V| < 2# 2 . 
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Show that 

n-l 

fn+2) = £ ^yCfl where |£ y 2| < 4 ^ 3j 



j=0 

and, more generally, 



fn+k) = ^ bj k f j \ where \b*\ < 2 k N k+1 

j = 0 

(d) Conclude from part (c) that, for any particular number x 9 there is 
a number M such that 

!/<«+*>(*) I < M • 2W* +1 for all £. 

(e) Now suppose that /(0) - /'(0) = • • • = f = 0. Show that 

O + A: + 1)! 
< M • \2Nx\ n + k+1 
" (n + k+ 1)! ' 

and conclude that / = 0. 

(f) Show that if /1 and f 2 are both solutions of the differential equation 

/<»> = T «y/«>, 

and /i ( »(0) = / 2 (i) (0) for 0 < ; < n - 1, then / x - / 2 . 

In other words, the solutions of this differential equation are deter- 
mined by the "initial conditions" (the values f j) (0) for 0 <j < 
n — 1). This means that we can find all solutions once we can find 
enough solutions to obtain any given set of initial conditions. If the 
equation 



has n distinct roots a h . . . , a ny then any function of the form 

/(*) = de™ + • • ■ + c n e a « x 

is a solution, and 

/(0) = a + • ' • + c n> 
/'(0) = OtxCi + • • ' + a^n, 

/n-i(Q) = + - . ■ + a/-V n . 



As a matter of fact, every solution is of this form, because we can 
obtain any set of numbers on the left side by choosing the c's 
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properly, but we will not try to prove this last assertion. (It is a 
purely algebraic fact, which you can easily check for n = 2 or 3.) 
These remarks are also true if some of the roots are multiple roots, 
and even in the more general situation considered in Chapter 26. 



18. (a) Let/0) = * 4 sin 1/x 2 for x * 0, and/(0) = 0. Show that / = 0 up 
to order 2 at 0, even though /"(0) does not exist. 

This example is slightly more complex, but also slightly more 
impressive, than the example in the text, because both f(a) and 
f\a) exist for a ^ 0. Thus, for each number a there is another num- 
ber m(a) such that 



namely, m(a) = f"(a) for a 0, and m(0) = 0. Notice that the 
function m defined in this way is not continuous. 

(b) Let / be a differentiable function. Suppose that there is a function m 
such that (*) holds for all numbers a, and that m is continuous. 
Prove that /"(a) exists for all a and equals m(a). Hint: Write (*) for 
x = a + h, a = a, and also for x = a, a — a + h. 

*(c) Suppose that there is a continuous function m such that 



(*) /(*) = /(«) + mix - a ) + "^>.( x - a y + R a ( x ) 




f(x) =f(a)+f'ia)(x-a) + 



f'ia) 



2 



ix - a y + 



mja) 
3! 



(x - a y 



+ Ra(x), 



where lim 



Ra(x) 



= 0. 



(x - a y 



Does it follow that f"'(a) = m(a)? 



* CHAPTER AlV e IS TRANSCENDENTAL 



The irrationality of e was so easy to prove that in this optional chapter we will 
attempt a more difficult feat, and prove that the number e is not merely 
irrational, but actually much worse. Just how a number might be even worse 
than irrational is suggested by a slight rewording of definitions. A number x 
is irrational if it is not possible to write x — a/b for any integers a and b, with 
b 7* 0. This is the same as saying that x does not satisfy any equation 

bx — a — 0 

for integers a and b, except for a = 0, b = 0. Viewed in this light, the irra- 
tionality of does not seem to be such a terrible deficiency; rather, it 
appears that V2 just barely manages to be irrational — although V2 is not the 
solution of an equation 

aix + a Q — 0, 
it is the solution of the equation 

x 2 - 2 = 0, 

of one higher degree. Problem 2-17 shows how to produce many irrational 
numbers x which satisfy higher-degree equations 

a n x n + a n -ix n ~ l + • • • + ao = 0, 

where the en are integers and a 0 ^ 0 (this condition rules out the possibility 
that all ai = 0). A number which satisfies an 4 4 algebraic" equation of this sort 
is called an algebraic number, and practically every number we have ever 
encountered is defined in terms of solutions of algebraic equations (ir and e 
are the great exceptions in our limited mathematical experience). All roots, 
such as 

V2, ^3, <Tl, 

are clearly algebraic numbers, and even complicated combinations, like 

^3 + V5 + </\ + V2 + </l 

are algebraic (although we will not try to prove this) . Numbers which cannot 
be obtained by the process of solving algebraic equations are called trans- 
cendental; the main result of this chapter states that e is a number of this 
anomalous sort. 

The proof that e is transcendental is well within our grasp, and was theo- 
retically possible even before Chapter 19. Nevertheless, with the inclusion of 
this proof, we can justifiably classify ourselves as something more than novices 
in the study of higher mathematics; while many irrationality proofs depend 
362 



e Is Transcendental 363 



only on elementary properties of numbers, the proof that a number is transcen- 
dental usually involves some really high-powered mathematics. Even the 
dates connected with the transcendence of e are impressively recent — the first 
proof that e is transcendental, due to Hermite, dates from 1873. The proof 
that we will give is a simplification, due to Hilbert. 

Before tackling the proof itself, it is a good idea to map out the strategy, 
which depends on an idea used even in the proof that e is irrational. Two 
features of the expression 

e = 1 + h + h + --- + h +R " 

were important for the proof that e is irrational: On the one hand, the number 

1 +^+ • • • +-. 

can be written as a fraction p/q with q < n ! (so that n ! (/>/ q) is an integer) ; 
on the other hand, 0 < R n < 3/(w + 1) ! (so n\R n is not an integer). These 
two facts show that e can be approximated particularly well by rational 
numbers. Of course, every number x can be approximated arbitrarily closely 
by rational numbers — if £ > 0 there is a rational number r with \x — r\ < e; 
the catch, however, is that it may be necessary to allow a very large denomi- 
nator for r, as large as 1 /s perhaps. For e we are assured that this is not the 
case: there is a fraction p/q within 3/(n + 1) ! of e, whose denominator q is at 
most n\. If you look carefully at the proof that e is irrational, you will see that 
only this fact about e is ever used. The number e is by no means unique in this 
respect: generally speaking, the better a number can be approximated by 
rational numbers, the worse it is (some evidence for this assertion is presented 
in Problem 3). The proof that e is transcendental depends on a natural 
extension of this idea: not only e, but any finite number of powers e, e 2 , . . . , 
e n , can be simultaneously approximated especially well by rational numbers. 
In our proof we will begin by assuming that e is algebraic, so that 

(*) a n e n + ' ' ' + aie + a 0 = 0, a 0 ^ 0 

for some integers a 0 , . . . , a n . In order to reach a contradiction we will then 
find certain integers M, M h . . . , M n and certain "small" numbers 
€i, . . . , € n such that 

Mi + e'i 

e L = ' 

M 

9 M 2 + e 2 
M 



M n + € n 
M 
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Just how small the e's must be will appear when these expressions are sub- 
stituted into the assumed equation (*). After multiplying through by M we 
obtain 



[a 0 M + aiMi + 



+ a n M n ] + Oitfi + 



+ e n a n ] = 0. 



The first term in brackets is an integer, and we will choose the M's so that it 
will necessarily be a nonzero integer. We will also manage to find e's so small 
that 

|ei<2i + * * * + e n a n \ < ^; 

this will lead to the desired contradiction — the sum of a nonzero integer and a 
number of absolute value less than ^ cannot be zero ! 

As a basic strategy this is all very reasonable and quite straightforward. 
The remarkable part of the proof will be the way that the Af's and e's are 
defined. In order to read the proof you will need to know about the gamma 
function! (This function was introduced in Problem 18-25.) 

THEOREM l e i s transcendental. 

PROOF Suppose there were integers a 0 , . . . , a n , with a 0 ^ 0, such that 

(*) a n e n + a n ^e n ' x + ■ • ■ + a 0 = 0. 
Define numbers M, M h ... , M n and ei, . . . , e n as follows. 

x*- l [{x -!)•••(*- n)] p e-* 



M 



(p - 1)! 
x p ~ l [(x -!)•••(* 



■ dx, 



»)]' 



(P - 1)! 
[(*-!)■•■(*- n)] p e~* 



k yP-l 



dx, 



dx. 



(p - 1)! 

The unspecified number p represents a prime number* which we will choose 
later. Despite the forbidding aspect of these three expressions, with a little 
work they will appear much more reasonable. We concentrate on M first. If 
the expression in brackets, 

[(* - 1) • • • (* - n)l 
is actually multiplied out, we obtain a polynomial 

x n + • • • + nl 

* The term "prime number" was defined in Problem 2-16. An important fact about prime 
numbers will be used in the proof, although it is not proved in this book: If p is a prime 
number which does not divide the integer a, and which does not divide the integer b, 
then p also does not divide ab. The Suggested Reading mentions references for this theorem 
(which is crucial in proving that the factorization of an integer into primes is unique). We 
will also use the result of Problem 2-1 6(d), that there are infinitely many primes — the reader 
is asked to determine at precisely which points this information is required. 
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with integer coefficients. When raised to the pth power this becomes an even 
more complicated polynomial 

***+••• ± (n\) p . 
Thus M can be written in the form 

np 

m = y - 1 — c„ f " 

Li (p - l)! Jo 

a = 0 

where the C a are certain integers, and Co = ±{n\) v . But 

/ *^ _x — k\. 
Jo 

Thus 

„.£ c<> (,-!+«)! . 



Now, for a = 0 we obtain the term 

We will now consider only primes p > n; then this term is an integer which is 
not divisible by p. On the other hand, if a > 0, then 

C * (P 7 1 = C °(P + a ~ M + « - 2) ■ • • A 

(/> — 1J! 

which «■ divisible by p. Therefore M itself is an integer which is not divisible 

by p. 

Now consider M^. We have 

= , r- -!)•■•(,- ^ dx 
)k (p-i)\ 

f x»- l [{x - 1) • ■ • (x - n)]^- (I - A> ^ 

A ~ (p-i)>. 

This can be transformed into an expression looking very much like M by the 
substitution 

u = x — k, 
du = dx. 

The limits of integration are changed to 0 and °o , and 

/•-(« + ky-*[{u + k-\) •••«•■•(« + *- n)]V ^ 
* io " " ~~ (>- D! 

There is one very significant difference between this expression and that for M. 
The term in brackets contains the factor u in the kth place. Thus the pth power 
contains the factor u p . This means that the entire expression 

(u + k) p ^[(u + *-!)■••(« + *- n)] p 
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is a polynomial with integer coefficients, every term of which has degree at least/?. 
Thus 

np np 

(p-\+a)\ 



U(p-\)\ Jo L (p-i)\ 

a=l a = 1 



where the D a are certain integers. Notice that the summation begins with 
a — 1 ; in this case every term in the sum is divisible by p. Thus each M k is an 
integer which is divisible by p. 
Now it is clear that 

k _ M k + e k 

e _ — , k — I, . . . , n. 

M 

Substituting into (*) and multiplying by M we obtain 

[a 0 M + a\M\ + * ' ' + a n M n ] + [aid + * * * + a n e n ] = 0. 

In addition to requiring that p > n let us also stipulate that p > \ao\. This 
means that both M and a 0 are not divisible by p, so a Q M is also not divisible 
by p. Since each M k is divisible by p, it follows that 

clqM + a\M\ + • • * + a n M n 

is not divisible by p. In particular it is a nonzero integer. 

In order to obtain a contradiction to the assumed equation (*), and thereby 
prove that e is transcendental, it is only necessary to show that 

|ai€i + • • • + a n € n \ 

can be made as small as desired, by choosing p large enough; it is clearly suffi- 
cient to show that each |€*| can be made as small as desired. This requires 
nothing more than some simple estimates; for the remainder of the argument 
remember that n is a certain fixed number (the degree of the assumed poly- 
nomial equation (*)). To begin with, if 1 < k < n, then 

n \x p ~ l [{x -!)••■(*- n)] p \e~ x 



\e k \ < e k f Q 



(/,-!)! 

n n p - 1[ \[(x - 1) • • • (x - n)] p \e~ x 



dx 
dx. 



(P - 1)! 

Now let A be the maximum of \(x — 1) • • • (x ~~ n)\ for x in [0, «]. Then 



(p - 


D! 


e n n p - 


-i A p 


(P ~ 


D! 


e n n p - 


■i A p 



< ~. r- / e~ x dx 



(P ~ D! 

cVA p e n {nAY 



(p-\)\ {p-\)\ 
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But n and A are fixed; thus (nA) p /(p — 1)1 can be made as small as desired 
by making p sufficiently large. | 

This proof, like the proof that w is irrational, deserves some philosophic 
afterthoughts. At first sight, the argument seems quite "advanced"— after all, 
we use integrals, and integrals from 0 to co at that. Actually, as many mathe- 
maticians have observed, integrals can be eliminated from the argument com- 
pletely; the only integrals essential to the proof are of the form 

fj x k e~ x dx, 

for integral k, and these integrals can be replaced by k ! whenever they occur. 
Thus M, for example, could have been defined initially as 

where C a are the coefficients of the polynomial 

[(* - 1) • ■ • * (* - n)Y. 

If this idea is developed consistently, one obtains a "completely elementary" 
proof that e is transcendental, depending only on the fact that 

, = 1 + i + i + i + .... 

1! 2! 3! 

Unfortunately, this "elementary" proof is harder to understand than the 
original one — the whole structure of the proof must be hidden just to eliminate 
a few integral signs! This situation is by no means peculiar to this specific 
theorem — "elementary" arguments are frequently more difficult than 
"advanced" ones. Our proof that ir is irrational is a case in point. You proba- 
bly remember nothing about this proof except that it involves quite a few com- 
plicated functions. There is actually a more advanced, but much more con- 
ceptual proof, which shows that 7r is transcendental, a fact which is of great 
historical, as well as intrinsic, interest. One of the classical problems of Greek 
mathematics was to construct, with compass and straightedge alone, a square 
whose area is that of a circle of radius 1 . This requires the construction of a 
line segment whose length is VV, which can be accomplished if a line segment 
of length 7r is constructible. The Greeks were totally unable to decide whether 
such a line segment could be constructed, and even the full resources of 
modern mathematics were unable to settle this question until 1882. In that 
year Lindemann proved that w is transcendental; since the length of any seg- 
ment that can be constructed with straightedge and compass can be written 
in terms of +, •, — , — ■, and V , and is therefore algebraic, this proves that a 
line segment of length 7r cannot be constructed. 

The proof that ir is transcendental requires a sizable amount of mathematics 
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which is too advanced to be reached in this book. Nevertheless, the proof is 
not much more difficult than the proof that e is transcendental. In fact, the 
proof for 7r is practically the same as the proof for e. This last statement should 
certainly surprise you. The proof that e is transcendental seems to depend so 
thoroughly on particular properties of e that it is almost inconceivable how 
any modifications could ever be used for 7r; after all, what does e have to do 
with 7r? Just wait and see! 

PROBLEMS 

1. (a) Prove that if a > 0 is algebraic, then is algebraic. 

(b) Prove that if a is algebraic and r is rational, then a + r and ar are 
algebraic. 

Part (b) can actually be strengthened considerably: the sum, product, 
and quotient of algebraic numbers is algebraic. This fact is too diffi- 
cult for us to prove here, but some special cases can be examined: 

2. Prove that V2 + V3 and V2(l + V3) are algebraic, by actually find- 
ing algebraic equations which they satisfy. (You will need equations of 
degree 4.) 

*3. (a) Let a be an algebraic number which is not rational. Suppose that a 
satisfies the polynomial equation 

/(*) = a n x n + a n ^x n ~ l + • • • + a 0 = 0, 

and that no polynomial function of lower degree has this property. 
Show that fip/q) 5* 0 for any rational number p/q. Hint: Use Prob- 
lem 3-7 (b). 

(b) Now show that \f(p/q)\ > \/q n for all rational numbers p/q with 
q > 0. Hint: Write f(p/q) as a fraction over the common denominator 
q\ 

(c) Let M = sup {|/'(*) I : \x - a\ < 1}. Use the Mean Value Theorem 
to prove that if p/q is a rational number with \a — p/q\ < 1, then 
\ a - p/q\ > \/Mq n . (It follows that for c = max(l, \/M) we have 
\a — p/q\ > c/q n for all rational p/q.) 

*4. Let 

a = 0.110010000000000000000001000 

where the Ts occur in the n \ place, for each n. Use Problem 3 to prove 
that a is transcendental. (For each n, show that a is not the root of an 
equation of degree n.) 

Although Problem 4 mentions only one specific transcendental number, it 
should be clear that one can easily construct infinitely many other numbers a 
which do not satisfy \a — p/q\ > c/q n for any c and n. Such numbers were 
first considered by Liouville (1809-1882), and the inequality in Problem 3 is 
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often called Liouville's inequality. None of the transcendental numbers con- 
structed in this way happens to be particularly interesting, but for a long time 
Liouville's transcendental numbers were the only ones known. This situation 
was changed quite radically by the work of Cantor (1845-1918), who showed, 
without exhibiting a single transcendental number, that most numbers are 
transcendental. The next two problems provide an introduction to the ideas 
that allow us to make sense of such statements. The basic definition with which 
we must work is the following: A set A is called countable if its elements can 
be arranged in a sequence 

01, 02, 03, 04, • ♦ • • 

The obvious example (in fact, more or less the Platonic ideal of) a countable 
set is N, the set of natural numbers; clearly the set of even natural numbers is 
also countable: 

2, 4, 6, 8, 

It is a little more surprising to learn that Z, the set of all integers (positive, 
negative, and 0) is also countable, but seeing is believing: 

0, 1, -1, 2, -2, 3, -3, ... . 

The next two problems, which outline the basic features of countable sets, are 
really a series of examples to show that (1) a lot more sets are countable than 
one might think and (2) nevertheless, some sets are not countable. 

*5. (a) Show that if A and B are countable, then so is A VJ B = {x: x is in A 
or x is in B}. Hint: Use the same trick that worked for Z. 

(b) Show that the set of positive rational numbers is countable. (This is 
really quite startling; use the following look-and-see proof: 

\ \ \ \ \ ' • • 
/ / / 

\ \ f \ i ■ ■ ■ 
t t i I — ) 

(c) Show that the set of all pairs (m, n) of integers is countable. (This is 
practically the same as part (b).) 

(d) If A h A 2 , . . . are each countable, prove that 



A X \J A 2 \J A 3 KJ ' ' ' 

is also countable. (Again use the same trick as in part (b).) 

(e) Prove that the set of all triples (/, m, n) of integers is countable. (A 
triple (/, m, n) can be described by a pair (/, m) and a number n.) 

(f) Prove that the set of all rc-tuples (a h a 2} ...,*„) are countable. (If 
you have done part (e), you can do this, using induction.) 
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(g) Prove that the set of all roots of polynomial functions of degree n is 
countable. (Part (f) shows that the set of all polynomial functions of 
degree n can be arranged in a sequence, and each of these functions 
has at most n roots.) 

(h) Now use parts (d) and (g) to prove that the set of all algebraic num- 
bers is countable. 

*6. Since so many sets turn out to be countable, it is important to note that the 
set of all real numbers between 0 and 1 is not countable. In other words, 
there is no way of listing all these real numbers in a sequence 



(decimal notation is being used on the right). To prove that this is so, 
suppose such a list were possible and consider the decimal 

0.5i 1 5 2 2 5 3 3 5 4 4 

where a n n = 5 if a n n 5 and a n n = 6 if a n n = 5. Show that this number 
cannot possibly be in the list, thus obtaining a contradiction. 

Problems 5 and 6 can be summed up as follows. The set of algebraic num- 
bers is countable. If the set of transcendental numbers were also countable, 
then the set of all real numbers would be countable, by Problem 5(a), and 
consequently the set of real numbers between 0 and 1 would be countable. 
But this is false. Thus, the set of algebraic numbers is countable and the set of 
transcendental numbers is not ("there are more transcendental numbers than 
algebraic numbers")- The remaining two problems illustrate further how 
important it can be to distinguish between sets which are countable and sets 
which are not. 

*7. Let / be a nondecreasing function on [0, 1]. Recall (Problem 8-8) that 
lim f(x) and lim f(x) both exist. 

x—*a + x-*a~ 

(a) For any e > 0 prove that there are only finitely many numbers a 
in [0, 1] with lim /(*) — lim /(#) > e. Hint: There are, in fact, at 

most [/(l) - /(0)]/e of them. 

(b) Prove that the set of points at which / is discontinuous is countable. 
Hint: If lim f(x) — lim /(*) > 0, then it is > 1/n for some natural 

x~*a + x—*a~ 

number n. 

This problem shows that a nondecreasing function is automatically 
continuous at most points. For differentiability the situation is more 
difficult to analyze and also more interesting. A nondecreasing func- 
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tion can fail to be differentiable at a set of points which is not count- 
able, but it is still true that nondecreasing functions are differentiable 
at most points (in a different sense of the word "most"). Reference 
[33] of the Suggested Reading gives a beautiful proof, using the 
Rising Sun Lemma of Problem 8-20. For those who have done 
Problem 9 of the Appendix to Chapter 11, it is possible to provide 
at least one application to differentiability of the ideas already 
developed in this problem set: If / is convex, then / is differentiable 
except at those points where its right-hand derivative /+' is discon- 
tinuous; but the function /+' is increasing, so a convex function is 
automatically differentiable except at a countable set of points. 

(a) Problem 11-50 showed that if every point is a local maximum point 
for a continuous function /, then / is a constant function. Suppose now 
that the hypothesis of continuity is dropped. Prove that / takes on 
only a countable set of values. Hint: For each x choose rational num- 
bers a x and b x such that a x < x < b x and x is a maximum point for 
/ on (a x , b x ) . Then every value f(x) is the maximum value of / on some 
interval (a x , b x ). How many such intervals are there? 

(b) Now deduce Problem 11-50 as a corollary of part (a). 

(c) Suppose that every point of / is either a local maximum or a local 
minimum point for /. Prove that / takes on only a countable set of 
values. (This is a minor variant of part (a).) 

(d) Now suppose that / is continuous, and that every point is either a 
local maximum or a local minimum point for /. Show that / is a con- 
stant function. (Although this statement is only a minor variant of 
Problem 11-50, the only proof I know uses part (c), and thus relies on 
very different ideas than the ones in Chapter 11.) 
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The idea of an infinite sequence is so natural a concept that it is tempting to 
dispense with a definition altogether. One frequently writes simply "an infinite 
sequence 

<Zl) #2} #3, <Z4 3 (35, . . . 

the three dots indicating that the numbers <z» continue to the right "forever." 
A rigorous definition of an infinite sequence is not hard to formulate, however; 
the important point about an infinite sequence is that for each natural num- 
ber,, ft, there is a real number a n . This sort of correspondence is precisely what 
functions are meant to formalize. 



DEFINITION 



An infinite sequence of real numbers is a function whose domain is N. 



From the point of view of this definition, a sequence should be designated 
by a single letter like a, and particular values by 

a(l), a(2), fl (3), 

but the subscript notation 

tfij #2, a Si . . . 

is almost always used instead, and the sequence itself is usually denoted by a 
symbol like {a n }. Thus {n}, {(-l) n }, and {\/n} denote the sequences a, ft 
and 7 defined by 

fin = ("l) n , 
1 

Tn = - 

n 

A sequence, like any function, can be graphed (Figure 1) but the graph is 
usually rather unrevealing, since most of the function cannot be fit on the page. 



(a) 

FIGURE 1 
372 



(b) 



'♦Hill 



(c) 
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05 = 03 = 01 



02 = 04 = 06 : 



FIGURE 2 



H 

0 76 7s 



A more convenient representation of a sequence is obtained by simply 
labeling the points ai, as, ... on a line (Figure 2). This sort of picture 
shows where the sequence 4 'is going. 55 The sequence {a n } "goes out to 
infinity, 55 the sequence {fi n \ "jumps back and forth between —1 and 1," and 
the sequence {y n j "converges to 0. 5 5 Of the three phrases in quotation marks, 
the last is the crucial concept associated with sequences, and will be defined 
precisely (the definition is illustrated in Figure 3). 



/ a N+ t a.y 



/+ 6 



FIGURE 3 



DEFINITION 



A sequence { a n } converges to I (in symbols lim a n = /) if for every g > 0 

n-~ * »o 

there is a natural number N such that, for all natural numbers n, 
if n > N, then \a n — l\ < s. 



In addition to the terminology introduced in this definition, we sometimes 
say that the sequence {a n } approaches I or has the limit /. A sequence {a n } is 
said to converge if it converges to / for some /, and to diverge if it does not 
converge. 

To show that the sequence { y n } converges to 0, it suffices to observe the 
following. If e > 0, there is a natural number N such that 1/N < e. Then, if 
n > N we have 

11 

Tn = - < - < e, so Y n - 0 < e. 
n N 



The limit 



lim Vn + 1 - Vn - 0 



will probably seem reasonable after a little reflection (it just says that + 1 
is practically the same as for large n) , but a mathematical proof might not 
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be so obvious. To estimate V f n + 1 — Vn we can use an algebraic trick: 

— /- (Vn + 1 -V~ n ){Vn + \ + Vn) 

Vrc= . 7= 

Vn + 1 +Vn 

n + 1 — n 
Vn + 1 + Vn 

1 



Vrc + 1 + Vrc 

It is also possible to estimate Vn + 1 — Vra by applying the Mean Value 
Theorem to the function /(*) = V x on the interval [n, n + 1]. We obtain 

Vn + 1 - Vn 



1 

2Vx 
1 

2 V^' 



> for some x in (n, n + 1) 



Either of these estimates may be used to prove the above limit; the detailed 
proof is left to you, as a simple but valuable exercise. 

The limit 

3rc 3 + 7n 2 + 1 = 3 
,™ 4/2 3 - 8n + 63 4 

should also seem reasonable, because the terms involving n z are the most 
important when n is large. If you remember the proof of Theorem 7-9 you will 
be able to guess the trick that translates this idea into a proof — dividing top 
and bottom by n z yields 

3rc 3 + In 2 + 1 n n z 



An z - 8n + 63 A 8 , 63 

4 " ~ 2 + T 
n 2 n 3 

Using this expression, the proof of the above limit is not difficult, especially if 
one uses the following facts: 

If lim a n and lim b n both exist, then 

n— » » n— * » 

lim (a n + b n ) = lim a n + lim b ni 

n— ► cc n— ► « n— > » 

lim (a n ' b n ) = lim a n • lim 

n— > ao n— » w n— » « 

moreover, if lim 6 n ^ 0, then b n ^ 0 for all 72 greater than some iV, and 

71— ► 00 

lim a n /b n = lim a w /lim £ ft . 
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(If we wanted to be utterly precise, the third statement would have to be even 
more complicated. As it stands, we are considering the limit of the sequence 
\c n ] = {a n /b n }, where the numbers c n might not even be defined for certain 
n < N. This doesn't really matter — we could define c n any way we liked for 
such n — because the limit of a sequence is not changed if we change the 
sequence at a finite number of points.) 

Although these facts are very useful, we will not bother stating them as a 
theorem — you should have no difficulty proving these results for yourself, 
because the definition of lim a n = / is so similar to previous definitions of 

n—+ oo 

limits, especially lim f(x) = /. 

X — ► 00 

The similarity between the definitions of lim a n = I and lim f(x) = I is 

n — * oo x — ► oo 

actually closer than mere analogy; it is possible to define the first in terms of 
the second. If/ is the function whose graph (Figure 4) consists of line segments 




FIGURE 4 



joining the points in the graph of the sequence {a n }, so that 

f(x) = (fln+i - a n )(x — n) + a n , n < x < n + 1, 



then 



lim a n — I if and only if lim f{x) — 1. 



This observation is frequently very useful. For example, suppose that 
0 < a < 1. Then 

lim a n = 0. 

To prove this we note that 

lim a x — lim e xlo * a 

X — » oo x — ► oo 

= o, 

since log a < 0, so that x log a is negative and large in absolute value for 
large x. Notice that we actually have 

lim a n - 0 if \a\ < 1; 

n— * oo 

for if a < 0 we can write 

lim a n = lim (~\) n \a\ n = 0. 
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THEOREM 1 



The behavior of the logarithm function also shows that if a > 1, then a n 
becomes arbitrarily large as n becomes large. This assertion is often written 

lim a n = oo, a > 1, 

n— > oo 

and it is sometimes even said that {a 71 } approaches <x> . We also write equations 
like 

lim —a n = — co 5 

n— » 00 

and say that { — a n \ approaches — oo. Notice, however, that if a < — 1, then 
lim a n does not exist, even in this extended sense. 

n— * oo 

Despite this connection with a familiar concept, it is more important to 
picture convergence in terms of the picture of a sequence as points on a line 
(Figure 3). There is another connection between limits of functions and limits 
of sequences which is related to this picture. This connection is somewhat less 
obvious, but considerably more interesting, than the one previously mentioned 
— instead of defining limits of sequences in terms of limits of functions, it is 
possible to reverse the procedure. 

Let / be a function defined in an open interval containing c, except perhaps 
at c itself, with 

lim /(*) - /. 

x— *c 

Suppose that {a n } is a sequence such that 

(1) each a n is in the domain of /, 

(2) each a n ^ c, 

(3) lim a n = c. 

n—* oo 

Then the sequence { f(a n ) } satisfies 

lim f(a n ) = I. 

n— »oo 

Conversely, if this is true for every sequence { a n } satisfying the above condi- 
tions, then lim f(x) = /. 



PROOF Suppose first that lim f(x) = /. Then for every e > 0 there is a 5 > 0 such 

x—*c 

that, for all #, 

if 0 < |* - c\ < d, then \f(x) - l\ < s. 
If the sequence {a n } satisfies lim a n = c, then (Figure 3) there is a natural 
number N such that, 

if n > N, then \a n — c\ < 8. 
By our choice of 8, this means that 

!/(*») - 1\ < 6, 
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FIGURE 5 



showing that 

lim f(a n ) = 1. 

n— ► *> 

Suppose, conversely, that lim f(a n ) =/ for every sequence {a n } with 

n—* *> 

lim a n = c. If lim f(x) = / were not true, there would be some £ > 0 such 

n— > <» x—>c 

that for *z#ry 5 > 0 there is an # with 

0 < |* - c\ < 8 but \f(x) - /| > s. 
In particular, for each n there would be a number x n such that 

0 < \x n - <r| < - but \f(x n ) - l\ > e. 

Now the sequence {# n } clearly converges to c but, since |/(# n ) — l\ > s for 
all n, the sequence |/(^ n )} does not converge to /. This contradicts the 
hypothesis, so lim f(x) = / must be true. | 

Theorem 1 provides many examples of convergent sequences. For example, 
the sequences {a n } and {b n } defined by 



-.in (.3+1) 



b n — cos 

clearly converge to sin(13) and cos(sin(l)), respectively. It is important, 
however, to have some criteria guaranteeing convergence of sequences which 
are not obviously of this sort. There is one important criterion which is very 
| easy to prove, but which is the basis for all other results. This criterion is stated 

ai ai 03 a * a in terms of concepts defined for functions, which therefore apply also to 

sequences: a sequence {a n \ is increasing if a n+ i > a n for all rc, nondecreasing 
if tfn+ i > o-n for all n, and bounded above if there is a number M such that 
a n < M for all n; there are similar definitions for sequences which are de- 
creasing, nonincr easing, and bounded below. 

THEOREM 2 If {a n } is nondecreasing and bounded above, then [a n } converges (a similar 
statement is true if {a n } is nonincreasing and bounded below). 

PROOF The set A consisting of all numbers a n is, by assumption, bounded above, so A 
has a least upper bound a. We claim that lim a n = a (Figure 5). In fact, 

if £ > 0, there is some cin satisfying a — aN < £, since a is the least upper 
bound of A. Then if n > N we have 

a n > aN, so a — a n < a — aN < £. 

This proves that lim a n = ot. | 
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The hypothesis that {a n } is bounded above is clearly essential in Theorem 
2: if {a n \ is not bounded above, then (whether or not {a n } is nondecreasing) 
{a n } clearly diverges. Upon first consideration, it might appear that there 
should be little trouble deciding whether or not a given nondecreasing 
sequence j a n } is bounded above, and consequently whether or not j a n } con- 
verges. In the next chapter such sequences will arise very naturally and, as 
we shall see, deciding whether or not they converge is hardly a trivial matter. 
For the present, you might try to decide whether or not the following (ob- 
viously increasing) sequence is bounded above: 

l, i + +* + *, i + * + 

Although Theorem 2 treats only a very special class of sequences, it is more 
useful than might appear at first, because it is alwayc possible to extract from 
an arbitrary sequence \a n \ another sequence which is either nonincreasing or 
else nondecreasing. To be precise, let us define a subsequence of the sequence 
\graph ofa R {^n} to be a sequence of the form 

%d a n 2 i a na ♦ • • j 

where the nj are natural numbers with 

ni < Hi < 72 3 < * * * 




2 and 6 are peak points 



H 1 1 1 1 1 1 1 1 1 h 



FIGURE 6 



1234 56 789 10 11 Then every sequence contains a subsequence which is either nondecreasing 

or nonincreasing. It is possible to become quite befuddled trying to prove this 
assertion, although the proof is very short if you think of the right idea; it is 
worth recording as a lemma. 

LEMMA Any sequence { a n } contains a subsequence which is either nondecreasing or 
nonincreasing. 

PROOF Call a natural number n a "peak point" of the sequence {a n \ if a m < a n for 
all m > n (Figure 6). 

Case 1. The sequence has infinitely many peak points. In this case, if Wi < ft 2 < 
n 3 < ' ' • are the peak points, then a ni > a n2 > a n} > ■ • * , so {a Uk } is the 
desired (nonincreasing) subsequence. 

Case 2. The sequence has only finitely many peak points. In this case, let n\ be 
greater than all peak points. Since m is not a peak point, there is some n 2 > «i 
such that a n2 > a nr Since n 2 is not a peak point (it is greater than m, and hence 
greater than all peak points) there is some n 3 > n 2 such that a nt > a nr Con- 
tinuing in this way we obtain the desired (nondecreasing) subsequence. | 

If we assume that our original sequence {a n \ is bounded, we can pick up 
an extra corollary along the way. 



COROLLARY (THE 
BOLZANO- WEIERSTRASS THEOREM) 



Every bounded sequence has a convergent subsequence. 
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DEFINITION 



Without some additional assumptions this is as far as we can go: it is easy 
to construct sequences having many, evenly infinitely many, subsequences 
converging to different numbers (see Problem 2). There is a reasonable 
assumption to add, which yields a necessary and sufficient condition for 
convergence of any sequence. Although this condition will not be crucial for 
our work, it does simplify many proofs. Moreover, this condition plays a funda- 
mental role in more advanced investigations, and for this reason alone it is 
worth stating now. 

If a sequence converges, so that the individual terms are eventually all close 
to the same number, then the difference of any two such individual terms 
should be very small. To be precise, if lim a n = / for some /, then for any 

n— * oo 

£ > 0 there is an N such that \a n - l\ < e/2 for n > N; now if both n > N 
and m > N, then 

\a n — a m \ < \a n — l\ + \l — a n 



£ , 6 
<- + -=£• 
2 2 



This final inequality, \a n — a m \ < £, which eliminates mention of the limit /, 
can be used to formulate a condition (the Cauchy condition) which is clearly 
necessary for convergence of a sequence. 



A sequence {a n \ is a Cauchy sequence if for every £ > 0 there is a natural 
number N such that, for all m and n, 

if m, n > N, then \a n — a m \ < £. 

(This condition is usually written lim \a m — a n \ = 0.) 



The beauty of the Cauchy condition is that it is also sufficient to ensure 
convergence of a sequence. After all our preliminary work, there is very little 
left to do in order to prove this. 

THEOREM 3 A sequence \a n } converges if and only if it is a Cauchy sequence. 

PROOF We have already shown that {a n } is a Cauchy sequence if it converges. The 
proof of the converse assertion contains only one tricky feature : showing that 
every Cauchy sequence {a n \ is bounded. If we take £ = 1 in the definition of 
a Cauchy sequence we find that there is some iV such that 

\a m — a n \ < 1 for m, n > N. 

In particular, this means that 

\a m — a N +i\ < 1 for all m > N. 

Thus {a m : m > N} is bounded; since there are only finitely many other ah 
the whole sequence is bounded. 
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The corollary to the Lemma thus implies that some subsequence of {a n } 
converges. 

Only one point remains, whose proof will be left to you: if a subsequence of 
a Cauchy sequence converges, then the Cauchy sequence itself converges. | 



PROBLEMS 
1. Verify each of the following limits. 



(i) lim -J- = 1. 
n-^» n 3 + 4 



(iii) lim V' ' + 1 - + 1 = 0. Hint: You should at least be able 

n— * » 

to prove that lim vV + 1 - vV = 0. 

n— » » 

(iv) lim = 0. Hint: «! = »(«— 1) * • • k\ for k < n, in particular, 

n— ► oo 



for A: < n/2. 

(v) lim = 1, a > 0. 

n—* «j 

(vi) lim V« = 1. 



(vii) lim 2 + n — 1 . 



(viii) lim V a n + b n = max{a, b). 

n—* oo 

(ix) lim = 0, where a(n) is the number of primes which divide n. 

n— » oo 72 

Hint: The fact that each prime is > 2 gives a very simple estimate 
of how small a{n) must be. 



i 



n-»oo n v ^ X p + 1 

(a) What can be said about the sequence {a n } if it converges and each 
a n is an integer? 

(b) Find all convergent subsequences of the sequence 1, —1, 1, — 1, 1, 
— 1 , . . . . (There are infinitely many, although there are only two 
limits which such subsequences can have.) 

(c) Find all convergent subsequences of the sequence 1, 2, 1, 2, 3, 1, 2, 
3, 4, 1, 2, 3, 4, 5, ... . (There are infinitely many limits which 
such subsequences can have.) 
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(d) Consider the sequence 

11 2i_23.i_23_Al 

2) 3) 3> 4j 4? 4) 5> 5? 5j 5j 6j • • • • 

For which numbers a is there a subsequence converging to a? 

3. (a) Prove that if a subsequence of a Cauchy sequence converges, then 

so does the original Cauchy sequence, 
(b) Prove that any subsequence of a convergent sequence converges. 

4. (a) Prove that if 0 < a < 2, then a < Via < 2. 
(b) Prove that the sequence 



V2, Vl V2, Vl y/ 2 V2, . . . 



converges. 

(c) Find the limit. Hint: Notice that if lim a n = /, then lim Vla n = 

n— * oo n—> op 

V2/, by Theorem 1. 
Identify the function /(*) = lim (lim (cos n \irx) 2k ) . (It has been men- 

n— * oo ► oo 

tioned many times in this book.) 

Many impressive looking limits can be evaluated easily (especially by the 
person who makes them up), because they are really lower or upper 
sums in disguise. With this remark as hint, evaluate each of the following. 
(Warning: the list contains one red herring which can be evaluated by 
elementary considerations.) 

r Ve+Ve* + - • • + 
(l) hm 



n 

,..v r V~e + V? + • : ; + ife" 

(n) hm 

n— ► oo Yl 

(iii) ^(^TT + --- + ^> 

(v) !l m . (^fry 2+ oTT2T» + ' " ' + (^r^)' 

(vi) lim ( " + - " 4- • • • + - " )• 

Although limits like lim V 7 « and lim a" can be evaluated using facts 

n— * oo n— ► » 

about the behavior of the logarithm and exponential functions, this 
approach is vaguely dissatisfying, because integral roots and powers can 
be defined without using the exponential function. Some of the standard 
"elementary" arguments for such limits are outlined here; the basic 
tooks are inequalities derived from the binomial theorem, notably 

(1 + h) n > 1 + nh> for h > 0; 
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and, for part (c), 

{1 + hr > l+nh + »±^ h >> n ±Z^) h *, {o rh>0. 

(a) Prove that lim a n = oo if a > 1, by setting a — 1 + h, where 

71— > OO 

h > 0. 

(b) Prove that lim a n = 0 if 0 < a < 1. 

(c) Prove that lim = 1 if a > 1, by setting = 1 + h and 

n— * oo 

estimating h. 

(d) Prove that lim Va = 1 if 0 < a < 1. 

n— > oo 

(e) Prove that lim = 1. 

n— * oo 

8. (a) Prove that a convergent sequence is always bounded. 

(b) Suppose that lim a n = 0, and that each a n > 0. Prove that the set 

n~> oo 

of all numbers a n actually has a maximum member. 

9. (a) Prove that 

1 1 
< log (n + 1 ) — log n < 



n + 1 n 
(b) If 

a n = 1 + - + - + ' ' ' H log n, 

2 3 ?? 

show that the sequence \a n j is decreasing, and that each <z n > 0. 
It follows that there is a number 



= lim ( 1 + • • • + - — log n) 

n-^« \ n / 



This number, known as Euler's number, has proved to be quite 
refractory; it is not even known whether y is rational. 
10. (a) Suppose that / is increasing on [1, oo). Show that 

/(i) +•••+/(«- ix * </(2) + • • • +/(»). 

(b) Now choose / = log and show that 



< rc! < < -; 



it follows that 



lim = 

n^oo n e 
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This result shows that Vn \ is approximately n/e, in the sense that 
the ratio of these two quantities is close to 1 for large n. But we cannot 
conclude that n \ is close to (n/e) n in this sense; in fact, this is false. 
An estimate for n\ is very desirable, even for concrete computa- 
tions, because n\ cannot be calculated easily even with logarithm 
tables. The standard (and difficult) theorem which provides the 
right information will be found in Problem 26-18. 
*11. This problem investigates for which x > 0 the symbol 

x zX ' ' ' 

makes sense. In other words, if we define ai{x) = x, 0 n +iM = x anix \ 
when does b(x) = lim a n (x) exist? 

n — ► oo 

(a) Prove that if b{x) exists, then x b(x) = b(x). 
(The situation is similar to that in Problem 4.) 

(b) According to part (a), if b{x) exists, then x can be written in the form 
y lly for some y. Conclude that 0 < x < e lle . Hint: Consider the 
graph of f(y) = (log y)/y, as in Problem 17-24. 

(c) Suppose, conversely, that 0 < x < e lle . Show that each a n {x) < e\ 
since {a n (x) \ is clearly increasing, this proves that b{x) exists (and 
also that b(x) < e). 

(d) Find b{Vl) and b(e^). 

(e) Prove that b is differentiate on (0, e 1/e ), and find a formula for 
b'(x) in terms of b{x). Hint: This part is similar to Problem 17-24(/). 

(f) Derive a formula for b r {x) by differentiating the equation x h{x) = 
b(x). (Of course, this method does not prove that b is differentiate.) 

*12. Prove that if lim a n = /, then 

n— ♦ oo 

lim (gi + • • • + = /. 

n—* oo n 

Hint: This problem is very similar to (in fact it is a special case of) 
Problem 13-34. 

*13. Suppose that a n ^ 0 for each n and that lim a n +i/a n = L Prove that 

n— * oo 

lim V a n — I. Hint: This requires the same sort of argument that works 

n— ► oo n — 

in Problem 12, together with the fact that lim V / a = 1, for a > 0. 

n— > oo 

14. (a) Suppose that {a n \ is a convergent sequence of points all in [0, 1]. 

Prove that lim a n is also in [0, 1]. 

n— * oo 

(b) Find a convergent sequence {a n } of points all in (0, 1) such that 
lim a n is not in (0, 1). 

n — > oo 

15. Suppose that / is continuous and that the sequence 

*,/«,/(/«),/(/(/(*))), • • • 
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FIGURE 7 



converges to /. Prove that / is a "fixed point'* for /, i.e., /(/) = /. Hint: 
Two special cases have occurred already. 

16. (a) Suppose that / is continuous on [0, 1] and that 0 < f(x) < 1 for all 

x in [0, 1]. Problem 7-1 i shows that / has a fixed point (in the 
terminology of Problem 15). If / is increasing, a much stronger state- 
ment can be made: For any x in [0, 1], the sequence 

*, /(*), /(/(*)), • • ■ 

has a limit (which is necessarily a fixed point, by Problem 1 5) . Prove 
this assertion, by examining the behavior of the sequence for f(x) > x 
and f(x) < x, or by looking at Figure 7. A diagram of this sort is 
used in Littlewood's Mathematician's Miscellany to preach the value 
of drawing pictures: "For the professional the only proof needed is 
[this Figure]." 

*(b) Suppose that / and g are two continuous functions on [0, 1], with 
0 < f(x) < 1 and 0 < g(x) < 1 for all x in [0, 1], which satisfy 
fog = g o f. Suppose, moreover, that / is increasing. Show that 
/ and g have a common fixed point; in other words, there is a num- 
ber / such that /(/) = / = g(l). Hint: Begin by choosing a fixed 
point for g. 

***(c) Does the conclusion of part (b) hold without the assumption that 
/ is increasing? 

The trick in Problem 15 is really much more valuable than Problem 15 
might suggest, and some of the most important "fixed point theorems" depend 
upon looking at sequences of the form from x, /(*), /(/(*)), .... A special, 
but representative, case of one such theorem is treated in Problem 18 (for 
which the next problem is preparation). 

17. (a) Use Problem 2-4 to show that if c t± 1, then 



+ c n = 



c m - c n+1 
1 - c 



(b) Suppose that \c\ < 1. Prove that 



lim c m + 



+ c n = 0. 



(c) Suppose that {* n } is a sequence with \x n — x n +i\ < c n > where 
c < 1. Prove that {x n } is a Cauchy sequence. 
*18. Suppose that / is a function on [a, b] such that 

(*) \f( x ) — /GO I ^ c \ x ~~ jvl> f° r a ^ * ancl y in [ a > 

where c < 1. (Such a function is called a contraction.) 

(a) Prove that / is continuous. 

(b) Prove that / has at most one fixed point. 
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(c) By considering the sequence 

*,/(*),/(/(*)), 

for any x in [a, b], prove that / does have a fixed point. (This result, 
in a more general setting, is known as the "contraction lemma.") 

Let {x n } be a sequence which is bounded, and let 

y n — SUp {x n , * n +l, *n+2, • • •}• 

(a) Prove that the sequence {y n \ converges. The limit lim y n is denoted 
by Urn * n or lim sup x n , and called the limit superior, or upper 

n— » so n— ► *> 

limit, of the sequence {x n \. 

(b) Find lim x n for each of the following: 

n— > « 

(ii) Xn = (-i)"-- 

(iii) X n = 

(iv) * n = vV 

(c) Define lim x n (or lim inf x n ) and prove that 

n— ► oo n— * * 

lim x n < lim # n . 

n— * oo n— > «o 

(d) Prove that lim x n exists if and only if lim x n = lim x n and that in 
this case lim x n = lim x n = lim * n . 

n— > oo n— * oo n— ► 00 

(e) Recall the definition, in Problem 8-18, of lim A for a bounded set 
A. Prove that if the numbers x n are distinct, then lim x n = lim 4, 

n-> oo 

where ^4 = {x n : n in N}. 

(a) Suppose that { 6 n } is nonincreasing, with b n > 0 for each n, and that 

m < ai + • • • + a n < M 

for all n. Prove that 

bitn < aibi + ■ • • + <z»& n < 6iM. 

This result is known as Abel's Lemma. Although it may not look 
very interesting, it is the basis for several very interesting results 
which will appear in later problem sets; in addition, the proof 
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depends on a rather tricky way of writing a\bi + • * • + a n b n . 
(b) Deduce that 

bm < akbk + 4 * * + a n b n < b k M 

(a trivial consequence of part (a), inserted only because it is needed 
later). 

*21. The Bolzano-Weierstrass Theorem is usually stated, and also proved, 
quite differently than in the text — the classical statement uses the notion 
of limit points. A point x is a limit point of the set A if for every £ > 0 
there is a point a in A with \x — a\ < £ but x 9* a. 

(a) Find all limit points of the following sets. 

(i) j-L- tfinNj. 

(ii) (-- + — : n and m in n) . 
\n m J 

(hi) {(-1)* [l +^J:rcinN). 

(iv) Z. 

(v) Q. 

(b) Prove that x is a limit point of A if and only if for every £ > 0 there 
are infinitely many points a of A satisfying \x — a\ < £. 

(c) Prove that lim A is the largest limit point of A, and lim A the 
smallest. 

The usual form of the Bolzano-Weierstrass Theorem states that if A 
is an infinite set of numbers contained in a closed interval [a, b], then 
some point of [a, b] is a limit point of A. Prove this in two ways: 

(d) Using the form already proved in the text. Hint: Since A is infinite, 
there are distinct numbers x h # 2 , # 3 , . . . in A. 

(e) Using the Nested Intervals Theorem. Hint: If [a, b] is divided into 
two intervals, at least one must contain infinitely many points of A. 

*22. Use the Bolzano-Weierstrass Theorem to prove that if / is continuous 
on [a, b], then / is bounded above on [a, b]. Hint: If / is not bounded 
above, then there are points x n in [a, b] with f(x n ) > n. 

**23. (a) Let {a n } be the sequence 

i, h f j is f , f , i, t> f , h % , • . • • 

Suppose that 0 < a < b < 1. Let A^(rz; a, 6) be the number of inte- 
gers j < n such that aj is in [a, b]. (Thus N(2; -g-, f) = 2, and 
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h f) = 3.) Prove that 



lim 

n-+oo ft 



(b) A sequence {a n } of numbers in [0, 1] is called uniformly dis- 
tributed in [0, 1] if 



for all a and b with 0 < a < b < 1 . Prove that if s is a step function 
defined on [0, 1], and {a n } is uniformly distributed in [0, 1], then 



(c) Prove that if \a n ) is uniformly distributed in [0, 1] and /is integrable 
on [0, 1], then 



(a) Let / be a function defined on [0, 1] such that lim f(y) exists for all 



a in [0, 1]. For any s > 0 prove that there are only finitely many 
points a in [0, 1] with |lim f(y) - f(a)\ > £. Hint: Show that the 



set of such points cannot have a limit point x, by showing that 
lim f(y) could not exist. 



(b) Prove that, in the terminology of Problem 20-5, the set of points 
where / is discontinuous is countable. This finally answers the ques- 
tion of Problem 6-16: If / has only removable discontinuities, then 
/ is continuous except at a countable set of points, and in particular, 
/ cannot be discontinuous everywhere. 



lim 



N(n; a, b) 



= b - a 



n 





CHAPTER *m*^ INFINITE SERIES 



Infinite sequences were introduced in the previous chapter with the specific 
intention of considering their "sums" 

a.\ + a 2 + a z + • • • 

in this chapter. This is not an entirely straightforward matter, for the sum 
of infinitely many numbers is as yet completely undefined. What can be 
defined are the " partial sums 5 ' 

s n = a\ + • ■ • + a n , 

and the infinite sum must presumably be defined in terms of these partial 
sums. Fortunately, the mechanism for formulating this definition has already 
been developed in the previous chapter. If there is to be any hope of com- 
puting the infinite sum a\ + a 2 + a 3 + • • • , the partial sums s n should 
represent closer and closer approximations as n is chosen larger and larger. 
This last assertion amounts to little more than a sloppy definition of limits: 
the "infinite sum" a\ + a 2 + a$ + ' * ' ought to be lim s n . This approach 

will necessarily leave the "sum" of many sequences undefined, since the 
sequence {j n } may easily fail to have a limit. For example, the sequence 

1, -1, 1, -1, . . . 

with a n = (— yields the new sequence 

si = ai = 1, 

^2 = ai + a 2 = 0, 

S3 = a\ + a 2 + a z = 1, 

Si = a\ + a 2 + az + ~ 0, 



for which lim s n does not exist. Although there happen to be some clever 

71— ► 00 

extensions of the definition suggested here (see Problems 8 and 23-11) it 
seems unavoidable that some sequences will have no sum. For this reason, an 
acceptable definition of the sum of a sequence should contain, as an essential 
component, terminology which distinguishes sequences for which sums can be 
defined from less fortunate sequences. 
388 
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DEFINITION 



The sequence {a n } is summable if the sequence {s n } converges, where 

s n — ai + ' ' ' + a n . 
In this case, lim s n is denoted by 

n— ►» 

^ a n (or, less formally, a\ + a 2 + as + * ' *) 

n = 1 

and is called the sum of the sequence {a n \ . 



The terminology introduced in this definition is usually replaced by less 
precise expressions; indeed the title of this chapter is derived from such every- 
day language. An infinite sum £ a n is usually called an infinite series, the 

n = l 

word "series" emphasizing the connection with the infinite sequence \a n \. 
The statement that [a n \ is, or is not, summable is conventionally replaced by 

the statement that the series £ a n does, or does not, converge. This terminol- 

71 = 1 

oo 

ogy is somewhat peculiar, because at best the symbol £ a n denotes a number 

(so it can't "converge"), and it doesn't denote anything at all unless \a n } is 
summable. Nevertheless, this informal language is convenient, standard, and 
unlikely to yield to attacks on logical grounds. 

Certain elementary arithmetical operations on infinite series are direct 
consequences of the definition. It is a simple exercise to show that if {a n \ and 
{ b n j are summable, then 

n = 1 

X C ' ° n 




As yet these equations are not very interesting, since we have no examples of 
summable sequences (except for the trivial examples in which the terms are 
eventually all 0). Before we actually exhibit a summable sequence, some 
general conditions for summability will be recorded. 

There is one necessary and sufficient condition for summability which can be 
stated immediately. The sequence {a n \ is summable if and only if the sequence 
\s n \ converges, which happens, according to Theorem 21-3, if and only if 
lim s m - s n * 0; this condition can be rephrased in terms of the original 

m,n— »*> 
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THE CAUCHY CRITERION 



THE VANISHING CONDITION 



sequence as follows. 

The sequence {a n } is summable if and only if 

lim a n +i +••■+«*=•(). 

m,n— ► 0° 

Although the Cauchy criterion is of theoretical importance, it is not very 
useful for deciding the summability of any particular sequence. However, one 
simple consequence of the Cauchy criterion provides a necessary condition for 
summability which is too important not to be mentioned explicitly. 



If \a n } is summable, then 



lim a n = 0. 



This condition follows from the Cauchy criterion by taking m = n + 1 ; it can 
also be proved directly as follows. If lim s n = I, then 

n— ► to 

lim a n = lim (s n — J n -i) = lim s n — lim j n _i 

n— » » n—* oo n — * » n—* » 

= 1-1 = 0. 

Unfortunately, this condition is far from sufficient. For example, lim 1 jn = 

n — ► oo 

0, but the sequence {\/n} is not summable; in fact the following grouping of 
the numbers \/n shows that the sequence \s n } is not bounded: 



> \ 

(2 terms, 
each > i) 



> * 
(4 terms, 
each > i) 



> h 
(8 terms, 
each > ft) 



The method of proof used in this example, a clever trick which one might 
never see, reveals the need for some more standard methods for attacking these 
problems. These methods shall be developed soon (one of them will give an 

alternate proof that ^ 1/n does not converge) but it will be necessary to first 

n= 1 

procure a few examples of convergent series. 

The most important of all infinite series are the "geometric series" 

|j r« = 1 + r + r 2 + r 3 + • • • . 

n = 0 

Only the cases \r\ < 1 are interesting, since the individual terms do not 
approach 0 if \r\ > 1. These series can be managed because the partial sums 

s n = 1 + r + • • • + r n 

can be evaluated in simple terms. The two equations 



s n = 1 + r + r 2 + 
rs n = r + r 2 + 



+ r n 

+ r n + r n+1 
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THE BOUNDEDNESS CRITERION 



lead to 

s n {\ - r) = 1 - r» +1 

or 

1 - r n+1 



*n = 



1 - r 



(division by 1 — r is valid since we are not considering the case r = 1). Now 
lim r n = 0, since \r\ < 1. It follows that 



1 , [r| < 1. 



Xr n = lim — — - 
n-*<* 1 — r 1 — r 

n = 0 

In particular, 

n=l n=0 

that is, 

i + i + i + • • • - 1, 

an infinite sum which can always be remembered from the picture in Figure 1 . 




FIGURE 1 



Special as they are, geometric series are standard examples from which 
important tests for summability will be derived. 

For a while we shall consider only sequences \a n \ with each a n > 0; such 
sequences are called nonnegative. If \a n \ is a nonnegative sequence, then 
the sequence {s n \ is clearly nondecreasing. This remark, combined with 
Theorem 21-2, provides a simple-minded test for summability : 

A nonnegative sequence {a n } is summable if and only if the set of partial 
sums s n is bounded. 

By itself, this criterion is not very helpful— deciding whether or not the set of 
all s n is bounded is just what we are unable to do. On the other hand, if some 
convergent series are already available for comparison, this criterion can be 
used to obtain a result whose simplicity belies its importance (it is the basis for 
almost all other tests). 



THEOREM 1 
(THE COMPARISON TEST) 



Suppose that 



0 < a n < b n for all n. 
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Then if ^ b n converges, so does ^ a n . 

n=l n=l 

PROOF If 

s n = ai + • ' • + a n , 
t n = bi+ • • ■ +b n , 

then 

0 < s n < t n for all n. 

00 

Now {/ n } is bounded, since ^ £ n converges. Therefore {s n } is bounded; 

n = l 

00 

consequently, by the boundedness criterion ^ # n converges. 

n = 1 

Quite frequently the comparison test can be used to analyze very com- 
plicated looking series in which most of the complication is irrelevant. For 
example, 



2 + sin 3 (rc + 1) 
2 n + n 2 



converges because 



and 



o < 2 ± sin3 (* + < A, 

2 n + n 2 2 n ' 



00 00 

X 2 n ~ 3 X r* 

n = 1 n = 1 

is a convergent (geometric) series. Similarly, we would expect the series 

y — 1 

L(2 n - 1 + sin 2 n 3 

n — 1 

to converge, since the nth term of the series is practically 1 /2 n . This last asser- 
tion really means that 

Hm ( L_y± = 1 , 

n-oo \2 n - 1 +sin 2 W/ 2* 

and this formulation shows us how to verify our conjecture. If we choose any 
number c > 1, then it is certainly true that 

0 * 2 "-l + sin*»' <C h f ° r lmge emUgh ^ 
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This shows that 



+ sin 2 n z 

converges for some N, and of course this implies convergence of the original 
series. 

It is also possible to use the comparison test backwards. Consider, for exam- 
ple, the series 

S n+ 1 
n 2 + r 

n = 1 

We would expect this series to diverge, since (n + l)/(n 2 + 1) is practically 
1 /n for large n. To prove this, choose any number c with 0 < c < 1. Then 

0 < - < c for large enough n. 

n n 2 + 1 

This shows that the series Y (n + \)/{n 2 + 1) diverges, because if it con- 

00 

verged, then by the comparison test £ \/n would also converge, and this we 

n = 1 

know is false. 

The comparison test yields other important tests when we use previously 
analyzed series as catalysts. Choosing the geometric series ^ the con " 

n = 0 

vergent series par excellence, we obtain the most important of all tests for 
summability. 



THEOREM 2 (THE ratio TEST) Let a n > 0 for all n, and suppose that 

lim — — = r. 

n— ► « <3 n 

00 

Then £ a n converges if r < 1. On the other hand, if r > 1, then the terms 

n = 1 

so 

a n do not approach 0, so £ <2 n diverges. (Notice that it is therefore essential 

n = 1 

to compute lim a n +i/a n and not lim a n /a n +\ 0 
PROOF Suppose first that r < 1 . Choose any number j with r < s < 1 . The hypothesis 

hm — ^ == r < 1 
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implies that there is some N such that 

^ < s for n > N. 
a n 

This can be written 

tfn+i < sa n for n > N. 

Thus 



Since Y 0^ = ajv V j* converges, the comparison test shows that 

fc = 0 fc = 0 

00 00 

Y tf n = Y fltf+fc 

converges. This implies the convergence of the series ^ <z n , which has only 

n = 1 

00 

finitely many terms not included in Y # rt . 

n = iV 

The case r > 1 is even easier. If 1 < j < r, then there is a number N such 
that 

a -^>s for n>N, 
a n 

which means that 

aN+k > tfj\rJ* > <zn k — 0, 1, ... . 

This shows that the individual terms of {# n } do not approach 0, so {a n } is not 
summable. | 

oo 

As a simple application of the ratio test, consider the series ^ 1/n !. Letting 

n = 1 

<z n = we obtain 

1 



an+i = (n+l) \ = »! = _J 

fln 1 0+1)! » + r 

n\ 

Thus 

Iim ^ = 0, 
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which shows that the series £ l/»! converges. If we consider instead the 

n = 1 

so 

series ^ r n /rc!, where r is some fixed positive number, then 



lim = Km -J- = 0, 



.R + 1 



so ^ r n /w ! converges. It follows that 



r 

lim - = 0, 

n->« n! 

a result already proved in Chapter 16 (the proof given there was based on the 
same ideas as those used in the ratio test). Finally, if we consider the series 



^ nr n we have 



lim = lim r = r, 

n _>„ nr n n->«= n 



since lim (n + l)/» = 1. This proves that if 0 < r < 1, then J rcr* con- 

7i — ► n = 1 

verges, and consequently 



lim nr n = 0. 



n— > » 



(This result clearly holds for - 1 < r < 0, also.) It is a useful exercise to pro- 
vide a direct proof of this limit, without using the ratio test as an intermediary. 

Although the ratio test will be of the utmost theoretical importance, as a 
practical tool it will frequently be found disappointing. One drawback of the 
ratio test is the fact that lim a n +Ja n may be quite difficult to determine, and 
may not even exist. A more serious deficiency, which appears with maddening 
regularity, is the fact that the limit might equal 1. The case lim a n+ i/a n = 1 

is precisely the one which is inconclusive: \a n \ might not be summable (for 
example, if a n = but then again it might be. In fact, our very next test 

will show that £ (1/n) 2 converges, even though 



/ i y 
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This test provides a quite different method for determining convergence or 
divergence of infinite series — like the ratio test, it is an immediate consequence 
of the comparison test, but the series chosen for comparison is quite novel. 

THEOREM 3 (THE integral TEST) Suppose that / is positive and decreasing on [1, oo), and that f(n) = a n for 

00 

all n. Then ^ a n converges if and only if the limit 

/,•/->.»/// 

exists. 

PROOF The existence of lim / / is equivalent to convergence of the series 

/,'/+/;/+/,'/+■••. 

Now, since / is decreasing we have (Figure 2) 

f{n + 1)< / < f{n). 

oo 

The first half of this double inequality shows that the series ^ a n +i may be 

n = l 

compared to the series ^ /, proving that ^ a n +i (and hence ^ a n ) 

^ n=l n=l n = 1 

converges if lim / exists. 

as 

The second half of the inequality shows that the series ^ f may be 

n = 1 

00 00 

compared to the series Y a ni proving that lim f A f must exist if Y a n 
converges. | 

Only one example using the integral test will be given here, but it settles the 
question of convergence for infinitely many series at once. If p > 0, the con- 
vergence of ^ \/n p is equivalent, by the integral test, to the existence of 

n = 1 

r 

Now 




FIGURE 2 



dx. 



L 



1 



1 + 1 



(P - 1) A*-i p - 1 P 
■ log A, p = 1. 



This shows that lim f A 1 /x p dx exists if p > 1, but notify < l.Thus Y l/n p 

A— » oo ^ 1 J^, 
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converges precisely for p > 1. In particular, ^ V* diverges. 

n = l 

The tests considered so far apply only to nonnegative sequences, but non- 
positive sequences may be handled in precisely the same way. In fact, since 

I a n = -( I - «,), 

n=l n = 1 

all considerations about nonpositive sequences can be reduced to questions 
involving nonnegative sequences. Sequences which contain both positive and 
negative terms are quite another story. 

If ^ a n is a sequence with both positive and negative terms, one can con- 

n = 1 

sider instead the sequence £ \a n \, all of whose terms are nonnegative. Cheer- 

fully ignoring the possibility that we may have thrown away all the interesting 
information about the original sequence, we proceed to eulogize those 
sequences which are converted by this procedure into convergent sequences. 



DEFINITION 



oo 00 

The series Y a n is absolutely convergent if the series Y \a n \ is con- 

vergent. (In more formal language, the sequence \a n \ is absolutely 
summable if the sequence \ \a n \\ is summable.) 



Although we have no right to expect this definition to be of any interest, it 
turns out to be exceedingly important. The following theorem shows that the 
definition is at least not entirely useless. 

THEOREM 4 Every absolutely convergent series is convergent. Moreover, a series is abso- 
lutely convergent if and only if the series formed from its positive terms and the 
series formed from its negative terms both converge. 

00 

PROOF If ^ \a n \ converges, then, by the Cauchy criterion, 

n = l 

lim |a n+ i| + * * * + \ a m\ = 0. 

m,n—K*> 

Since 

|fl n +l + ' ' ' + a m \ < + • " • + km|, 

it follows that 

lim a n +\ + ' ' ' + a m = 0, 

m,n—> » 

00 

which shows that ^ a n converges. 
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To prove the second part of the theorem, let 



An, 


if 


a n 


> o 


o, 


if 


a n 


< o, 




if 


O-n 


< 0 




if 


dn 


> o, 



so that ^ a n + is the series formed from the positive terms of ^ a n , and 

n = 1 n = 1 

^ a n ~ is the series formed from the negative terms. 

n = l 

If ^ and ^ a n ~ both converge, then 

n= 1 n=l 

00 OO 00 00 

n = 1 n = 1 n = 1 n = l 

00 

also converges, so ^ <z n converges absolutely. 

n = l 

00 

On the other hand, if ^ |<z n | converges, then, as we have just shown, 

n = 1 

oo 

^ a n also converges. Therefore 

n = 1 

t *» + - id * + s m ) 



and 



both converge. | 



It follows from Theorem 4 that every convergent series with positive terms 
can be used to obtain infinitely many other convergent series, simply by put- 
ting in minus signs at random. Not every convergent series can be obtained in 
this way, however — there are series which are convergent but not absolutely 
convergent (such series are called conditionally convergent). In order to 
prove this statement we need a test for convergence which applies specifi- 
cally to series with positive and negative terms. 

THEOREM 5 (LEIBNIZ'S THEOREM) Suppose that 

a\ > a-i > az > ■ ■ • > 0, 

and that 

lim a n = 0. 
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Then the series 

00 

£ (-l) n+1 <Z n = ai — 02 + <Z 3 — <Z4 + <Z 5 - ' * * 

71 — 1 

converges. 

PROOF Figure 3 illustrates relationships between the partial sums which we will 
establish: 

(1) S 2 < Si < Sq < • ' • , 

(2) Si > S 3 > S 5 > ' ' ' , 

(3) Sk < si if k is even and / is odd. 



H H — t— 

56 *S •SlO -^12 



— H — I — H 



FIGURE 3 



To prove the first two inequalities, observe that 

(1) S 2n +2 = S2n + «2n+l - #2n 

> S2n, Since fl2n+l > ^2nJ 

(2) S2n+S = ^n+l — #2n + 2 + #2n+3 

> ^2n+lj Since #2n+2 > «2n+3- 

To prove the third inequality, notice first that 

S2n " S2n-\ ~~ fl 2n 

< i-2n-i, since a 2n > 0. 
This proves only a special case of (3), but in conjunction with (1) and (2) the 
general case is easy: if k is even and / is odd, choose n such that 

2n> k and In - 1 > /; 

then 

Sk < S2n < S2n-\ < ^> 

which proves (3). 

Now, the sequence {s 2n } converges, because it is nondecreasing and is 
bounded above (by s t for any odd /). Let 

a = sup {s 2n } = hm jr 2n . 

n— * » 

Similarly, let 

(S = inf {^2n+l} — nm S2n+1- 
n— * 00 

If follows from (3) that a < 0; since 

*2n+l - ^2n = «2n+l and UlH fl n = 0 

n— » « 

it is actually the case that a = 0. This proves that a = 0 = lim s n , | 
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The standard example derived from Theorem 5 is the series 

i -* + *-* + * , 

which is convergent, but not absolutely convergent (since ^ \/n does not 

71 = 1 

converge). If the sum of this series is denoted by x, the following manipulations 
lead to quite a paradoxical result: 

* = i -i + i-i + i -£+ • • • 

= l- i- i + |- i- i + i-T 1 o- T V + + -i 1 r-iV+--- 
(the pattern here is one positive term followed by two negative ones) 

= (i - i) - i + (i - i) - i + (* - A) - A + (t - A) - A 

+ ■ . . 

= *- i + *- i + A- A + A- A+ -- - 
-id - * + *- * + *- * + + -*+•■■) 

so x = */2, implying that * = 0. On the other hand, it is easy to see that 
x ^ 0: the partial sum s 2 equals ^, and the proof of Leibniz's Theorem shows 
that x > sz. 

This contradiction depends on a step which takes for granted that opera- 
tions valid for finite sums necessarily have analogues for infinite sums. It is 
true that the sequence 

{b n } = 1, -i, -h h -h -h h - T V, -tV, • • • 
contains all the numbers in the sequence 

{a n } = 1, — i, t? h —h y ? — h i> — A> A> — A> * ' " • 

In fact, \b n ) is a rearrangement of {<z n } in the following precise sense: each 
b n — <2/(n) where / is a certain function which "permutes" the natural num- 
bers, that is, every natural number m is f(n) for precisely one n. In our 
example 

/(2m + 1) = 3m + 1 (the terms 1, ... go into the 1st, 4th, 7th, . . . 
places), 

/(4m) = 3m (the terms — — A, ■ • • go into the 3rd, 6th, 

9th, . . . places), 

/(4m + 2) = 3m + 2 (the terms -A, ... go into the 2nd, 

5th, 8th, . . . places). 

SB 00 

Nevertheless, there is no reason to assume that ^ b„ should equal ^ a n : 

n = l n = 1 

these sums are, by definition, lim b\ + ■ • • + b n and lim ai + * ■ • + a n , 

n— ► <*> n—* oo 

so the particular order of the terms can quite conceivably matter. The series 
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00 

2* is not special in this regard; indeed, its behavior is typical of 

n = 1 

series which are not absolutely convergent— the following result (really more 
of a grand counterexample than a theorem) shows how bad conditionally 
convergent series are. 

00 

THEOREM 6 If ^ a n converges, but does not converge absolutely, then for any number a 

n = l 

00 

there is a rearrangement \b n ] of {a n \ such that ^ b n = a. 

n= 1 

00 

PROOF Let ^ pn denote the series formed from the positive terms of {a n } and let 

n = l 

y denote the series of negative terms. It follows from Theorem 4 that at 

least one of these series does not converge. As a matter of fact, both must fail 
to converge, for if one had bounded partial sums, and the other had un- 
bounded partial sums, then the original series V a n would also have un- 

n = 1 

bounded partial sums, contradicting the assumption that it converges. 

Now let a be any number. Assume, for simplicity, that a > 0 (the proof for 

oo 

a < 0 will be a simple modification). Since the series £ Pn is not convergent, 

n = 1 

there is a number N such that 

n = 1 

We will choose JVi to be the smallest N with this property. This means that 

JVi-l 

(1) 1 Pn < a, 

n = l 

but (2) ^p n > a. 



n = l 

Then if 

N^ 

Si - £ j»„, 

n = 1 

we have 



This relation, which is clear from Figure 4, follows immediately from equation 

^1 — < — ^ /> n = pNi> 
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0 pi + 

FIGURE 4 



To the sum Si we now add on just enough negative terms to obtain a new sum 
T\ which is less than a. In other words, we choose the smallest integer M i 
for which 

Mi 

T x =Si+ J q n <Oi. 

71 = 1 

As before, we have 

a — Ti < —qM v 

We now continue this procedure indefinitely, obtaining sums alternately 
larger and smaller than a, each time choosing the smallest N k or M k possible. 
The sequence 

• Pu • • • ,pN s9 qi, . . . , qM„pN l+ \, . . . ,pN t , • • • 

is a rearrangement of j a n } . The partial sums of this rearrangement increase 
to S u then decrease to T h then increase to S 2 , then decrease to T 2 , etc. To 
complete the proof we simply note that \S k — a\ and \ T k — a\ are less than 
or equal to pN k or —qM k , respectively, and that these terms, being members 

of the original sequence {a n }, must decrease to 0, since ^ a n converges. | 

n = 1 

Together with Theorem 6, the next theorem establishes conclusively the 
distinction between conditionally convergent and absolutely convergent 
series. 

theorem 7 If ^ a n converges absolutely, and {b n } is any rearrangement of {a n }, then 

n = l 

00 

^ b n also converges (absolutely), and 

n = 1 




n=l n=l 



PROOF Let us denote the partial sums of {a n } by s n , and the partial sums of {b n } 
by t n . 

00 

Suppose that £ > 0. Since ^ a n converges, there is some N such that 

n = l 

| ^ a n — j-at | < e. 
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oe 

Moreover, since ^ \a n \ converges, we can also choose N so that 

n = 1 

f knl - (W + • • • + M) < s, 

n = 1 

i.e., so that 

Now choose M so large that each of a u • • • , aa- appear among b h . . . , b M . 
Then whenever m > M, the difference t m - s N is the sum of certain a u where 
At, . . . , aw are definitely excluded. Consequently, 

\t m — S N \ < |flA'+l| + |flJV+2| + |flA T +3| + * ' * • 

Thus, if m > M, then 

| £ a n — / m I = I ^a n -s N + U-s N \ 

n-l n=l 

06 

< | ^ tf n — JA J + \tm — Sn\ 

n = l 

< s + s. 

Since this is true for every £ > 0, the series Y b n converges to £ a n . To 

„ = 1 n - 1 

prove that it converges absolutely, notice that the above argument can be 

applied to the positive terms of £ <2 n and the negative terms separately; this 
shows that the series formed from the positive and negative terms of £ b n 

n = 1 

00 

each converge, so ^ 6 n converges absolutely. | 

n = 1 

The theorems of this chapter have been concerned with summability of 
sequences, but not with the actual sums. Generally speaking, there is no reason 
to presume that a given infinite sum can be "evaluated' 5 in any simpler terms. 
However, many simple expressions can be equated to infinite sums by using 
Taylor's Theorem. Chapter 19 provides many examples of functions for which 

n 

where lim R n ,a{*) = 0- This is precisely equivalent to 

n—> oo 

n-* oo Z— / i ! 
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which means, in turn, that 

/(*) 



i = 0 

As particular examples we have 



sin x 




* 3 
3! 


x b 
+ - 
5! 


X 1 

_ rL + . . . 


cos X 




X 2 

2! 


X* 

+ - 
4! 


— _ -f . . . 


e x 


= 1 + 


X 

U 


X 2 

+ - 
2! 


a: 3 a: 4 

+-+-+ • 

3! 4! 


arctan x 




X 3 

3 


a: 5 

+ T 


_ fL + . . . 
7 + 


log(l + *) 




X 2 

2 


x z 


# 4 a: 5 

--+-+ • 

4 5 



M < 

, -1 < X < 1. 

(Notice that the series for arctan * and log(l + x) do not even converge for 
\x\ > 1; in addition, when # = — 1, the series for log(l + x) becomes 

-i -i-i-i 

which does not converge.) 

Some pretty impressive results are obtained with particular values of x: 

T Z 7T 5 TT 7 
0 = 7T + ' * ' , 

3! 5! 7! 

e = 1 + h + h + h + ---' 

E-,_i + i_i + ... f 

4 3 5 7 

, ^ , 1,1 1 , 

log2 = l-- + ---+.... 

More significant developments may be anticipated if we compare the series 
for sin x and cos x a little more carefully. The series for cos x is just the one 
we would have obtained if we had enthusiastically differentiated both sides 
of the equation 

x* . x b 

sin x = x • * * 

3! 5! 

term-by-term, ignoring the fact that we have never proved anything about the 
derivatives of infinite sums. Likewise, if we differentiate both sides of the 
formula for cos x formally (i.e., without justification) we obtain the formula 
cos'(*) = — sin x, and if we differentiate the formula for e x we obtain 
exp'(*) = exp(*). In the next chapter we shall see that such term-by-term 
differentiation of infinite sums is indeed valid in certain important cases. 
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PROBLEMS 

1. Decide whether each of the following infinite series is convergent or 
divergent. The tools which you will need are Leibniz's Theorem and 
the comparison, ratio, and integral tests. A few examples have been 
picked with malice aforethought; two series which look quite similar 
may require different tests (and then again, they may not). The hint 
below indicates which tests may be used. 

eo 

sin nd 



<" i-. 



GO 1 -* + *-■*■+ ' * • - 

(iii) 1 -i+f - i+*-i+t-*+ 



(iv) £(- 



(vi) 

(vii) 

(viii) 

(ix) 

(x) 

(xi) 



(xiy 



1) : 



logn 



n 

n = i 



(v) Y — \ (The summation begins with n = 2 simply to 

n ~2 ~^ n<1 ~ 1 avoid the meaningless term obtained for n = 1.) 



y 1 

</n} + 1 

n — 1 

00 

n = 1 

Z-/ log n 

n = 2 

eo 

S (log n)"' 

n = 2 

00 

S Gog nY 



(xii) Y (-!)»— 1_. 
Zv (log n)» 

n = 2 

eo 

(xiii) 



n 3 + 1 



eo 
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(xv) V-L-. 

1-1 n log n 

n-2 

00 

^ XVi ) / "71 \~2 

n — 2 

00 

1 



(xvii) 



_,n 2 (log n) 

oo 

(xvii ° s?* 

n = l 



n = l 

Hint: Use the comparison test for (i), (ii), (v), (vi), (ix), (x), (xi), (xiii), 
(xiv), (xvii); the ratio test for (vii), (xviii), (xix), (xx); the integral test 
for (viii), (xv), (xvi). 

The next two problems examine, with hints, some infinite series that require 
more delicate analysis than those in Problem 1. 

*2. (a) If you have successfully solved examples (xix) and (xx) from 

00 

Problem 1, it should be clear that ^ a n n\/n n converges for a < e 

n = 1 

and diverges for a > e. For a = e the ratio test fails; show that 

00 

^ e n n\/n n actually diverges, by using Problem 21-10. 

71 = 1 

00 

(b) Decide when ^ n n /a n n\ converges, again resorting to Problem 

n = l 

21-10 when the ratio test fails. 

00 00 

*3. Problem 1 presented the two series ^ (log n)~ k and ^ (log n)~ n , of 

n=2 n=2 

which the first diverges while the second converges. The series 

00 

1 



(log n) los n 

n = 2 



which lies between these two, is analyzed in parts (a) and (b). 

00 

(a) Show that JJ e v /yv dy exists, by considering the series £ {e/n) n . 



Infinite Series 407 



(b) Show that 



; (log n) 



logn 



converges, by using the integral test. Hint: Use an appropriate 
substitution and part (a), 
(c) Show that 

V* 1 



Z/(log n) l0 « (l0 « n) 

diverges, by using the integral test. Hint: Use the same substitution 
as in part (b), and show directly that the resulting integral diverges. 

4. (a) Let {a n } be a sequence of integers with 0 < a n < 9. Prove that 

y a n 10~ n exists (and lies between 0 and 1). (This, of course, is the 

number which we usually denote by G.aia2a 3 ai . . . .) 

(b) Suppose that 0 < x < 1 . Prove that there is a sequence of integers 

{a n } with 0 < a n < 9 and £ a n \0~ n = x. Hint: For example, 

n-l 

ai = [10*] (where [y] denotes the greatest integer which is < y). 

(c) Show that if \a n } is repeating, i.e., is of the form a h a 2 , . . . , 

CO 

ai, 02, • • • , ak, ai, a 2 , . . . , then ^ a n \0 n is a rational number 

n = l 

(and find it). The same result naturally holds if \a n } is eventually 
repeating, i.e., if the sequence {a N+k } is repeating for some N. 

00 

(d) Prove that if x = £ a n \0' n is rational, then {a n \ is eventually 

n = 1 

repeating. (Just look at the process of finding the decimal expansion 
of p/q — dividing q into p by long division.) 

5. Suppose that \a n ) satisfies the hypothesis of Leibniz's Theorem. Use the 
proof of Leibniz's Theorem to obtain the following estimate: 

| ^ (-l) n+1 «» - [«i ~ at + • • • ± a N ]\< a N . 

n — l 

6. Prove the following theorem (another kind of "comparison test"). If 

00 

a n , b n > 0 and lim a n /b n = c ^ 0, then T a n converges if and only 

00 

if ^ converges. 
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7. Prove that if a n > 0 and lim Va n = r, then S a n converges if r < 1, 

and diverges if r > 1. (The proof is very similar to that of the ratio test.) 

This result is known as the "root test." It is easy to construct series for 
which the ratio test fails, while the root test works. For example, the root 
test shows that the series 

i + (i) 2 + (i) 2 + (i) 3 + (i) 3 + • • • 

converges, even, though the ratios of successive terms do not approach a 
limit. Most examples are of this rather artificial nature, but the root test 
is nevertheless quite an important theoretical tool, and if the ratio test 
works the root test will also (by Problem 21-13). It is possible to elimir- 
nate limits from the root test; a simple modification of the proof shows 

00 

that ^ a n converges if there is some s < 1 such that all but finitely many 

n = l 

00 

^/a n are < s, and that ^ a n diverges if infinitely many are > 1. 

n - 1 

This result is known as the "delicate root test" (there is a similar delicate 
ratio test). It follows, using the notation of Problem 21-19, that ^ a n 

n = 1 

converges if lim < 1 and diverges if lim > 1 : no conclusion 

n—* * n — > oo 

is possible if lim 

8. A sequence \a n ) is called Cesaro summable, with Cesaro sum /, if 

lim " + • • • + f* = / 

n— * oo n 

(where s k = <2i + * • * + a k ). Problem 21-12 shows that a summable 
sequence is automatically Cesaro summable, with sum equal to its 
Cesaro sum. Find a sequence which is not summable, but which is 
Cesaro summable. 

9. This problem outlines an alternative proof of Theorem 7 which does not 
rely on the Cauchy criterion. 

(a) Suppose that a n > 0 for each n. Let \b n } be a rearrangement of 
{a n \, and let s n = a\ + • • ■ + a n and t n = bi + ■ * ' + b n . 
Show that for each n there is some m with ^ n < t m . 



(b) Show that ^ a n < £ b n 
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00 00 

(c) Show that ^ a n = ^ b n . 

n=l n=l 

00 

(d) Now replace the condition a n > 0 by the hypothesis that ^ a n 

n = 1 

converges absolutely, using the second part of Theorem 4. 

10. (a) Prove that if ^ a n converges absolutely, and {b n } is any subse- 

n = 1 

00 

quence of {a n }, then £ 6 n converges (absolutely). 

n = 1 

00 

(b) Show that this is false if ^ a n does not converge absolutely. 

n = 1 

*(c) Prove that if ^ a n converges absolutely, then 

n = l 

oo 

^ = Ol + «3 + ^5 + ' ' ') + («a + ^4 + «6 + ' ' 

n = l 

00 00 00 

11. Prove that if Y a n is absolutely convergent, then | ^ a n | < £ \a n \. 

n = l "=1 » = 1 

*12. Problem 18-28 shows that j^" (sin x) fx dx converges. Prove that 
J Q | (sin x)/x\ dx diverges. 

*13. Find a continuous function / with /(*) > 0 for all x, such that J" f(x) dx 
exists, but lim f(x) does not exist. 

X-+00 

*14. Let f(x) = x sin 1 /x for 0 < a: < 1, and let /(0) = 0. Recall the defini- 
tion of t(f, P) from Problem 15-32. Show that the set of all /(/, P) for 
P a partition of [0, 1] is not bounded (thus / has "infinite length"). 
Hint: Try partitions of the form 

15. Let / be the function shown in Figure 5. Find J* /, and also the area of 

the shaded region in Figure 5. 
*16. In this problem we will establish the "binomial series' 5 

00 

(i + *)« = £(«>*, W<i, 

fc-0 

for any a, by showing that lim R n ,o( x ) = °- The P roof is in several 
steps, and uses the Cauchy and Lagrange forms as found in Problem 1 9-6. 
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so 

(a) Use the ratio test to show that the series ^ (^j r k does indeed con- 

verge for |r| < 1 (this is not to say that it necessarily converges to 
(1 + r) a ). It follows in particular that lim ( a ) r n = 0 for \r\ < 1. 

n— >oo \ TL J 

(b) Suppose first that 0 < x < 1. Show that lim /?„,<>(*) = 0, by using 

n— » oo 

Lagrange's form of the remainder, noticing that (1 + t) a ~ n ~ l < 1 
for n + 1 > a. 

(c) Now suppose that — 1 < x < 0; the number * in Cauchy's form of the 
remainder satisfies — 1 < x < t < 0. Show that 

+'0*" 1 | < \x\M, where M = max(l, (1 + x)*- 1 ), 

and 

x - t 



1 + / 

Using Cauchy's form of the remainder, and the fact that 
show that lim /? n(0 (Ar) = 0. 

n— » oo 

*17. (a) Suppose that the partial sums of the sequence {a n \ are bounded, 
and that \b n ) is a decreasing sequence with lim b n = 0. Prove that 

n— * oo 

00 

^ a rt 6„ converges. Hint: Use Abel's Lemma (Problem 21-20) to 

n = 1 

check the Cauchy criterion. 

(b) Derive Leibniz's Theorem from this result. 

(c) Prove, using Problem 15-31, that the series ^ (cos nx)/n converges 

n = l 

if* is not of the form 2kir for any integer £ (in which case it clearly 
diverges) . 

OO 

*18. Suppose \a n ] is decreasing and lim a n = 0. Prove that if \ a » con " 
verges, then ^ 2 n <2 2 » also converges (the "Cauchy Condensation 

n — l 

OO 

Theorem"). Notice that the divergence of ^ 1/n is a special case, for if 

n = l 

00 00 

£ 1/n converged, then ^ 2 n (l/2 n ) would also converge; this remark 

n= 1 n=l 

may serve as a hint. 
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*19. (a) Prove that if £ a n 2 and ^ 6 n 2 converge, then £ 0 n £ n converges. 

n = l n = l n = 1 

(b) Prove that if £ <z n 2 converges, then ^ fl nA converges. 

n=l n=l 

*20. Suppose {a n } is decreasing and each a n > 0. Prove that if ^ a n con- 

n = 1 

verges, then lim na n = 0. Hint: Write down the Cauchy criterion and 
be sure to use the fact that \a n ] is decreasing. 

00 

*21. If ; a n converges, then the partial sums s n are bounded, and lim a n = 

n = 1 

0. It is tempting to conjecture that boundedness of the partial sums, 

00 

together with the condition lim a n = 0, implies convergence of \ a n . 

" n = 1 

This is not true, but finding a counterexample requires a little 
ingenuity. As a hint, notice that some subsequence of the partial sums 
will have to converge; you must somehow allow this to happen, without 
letting the sequence itself converge. 

oo 

*22. The divergence of ^ \/n is a particular consequence of the following 

n = 1 

remarkable fact: Any positive rational number x can be written as a 
finite sum of distinct numbers of the form \/n. Such a representation can 
always be found by the straightforward method of continually adding 
on the next number in the sequence which is not too large. For example, 
the calculation 

» - i = U 

tt < f 

shows that 

Notice that the numerators 23, 13, 11, 1 are decreasing. Prove that 
every positive rational x can be written in such a way by showing that 
the numerators in this sort of calculation must always decrease, so that 
eventually the remainder has numerator 1. Hint: You just have to check 
that if p/q < \/n, but p/q > \/(n + 1), then the numerator of p/q - 
l(n + 1) is, less than p. 



23 



UNIFORM CONVERGENCE AND 
CHAPTER g^+J POWER SERIES 



The considerations at the end of the previous chapter suggest an entirely new 
way of looking at infinite series. Our attention will shift from particular 
infinite sums to equations like 

X x^ 
e* = 1 + — + f. + . . . 

1! 2! 

which concern sums of quantities that depend on x. In other words, we are 
interested in functions defined by equations of the form 

/(*) =AW +/tW +/aW + • • ■ 

(in the previous example f n {x) = x n ~ l /(n — 1)!). In such a situation {/„} 
will be some sequence of functions; for each x we obtain a sequence of num- 
bers {/»(*)}, and /(#) is the sum of this sequence. In order to analyze such 
functions it will certainly be necessary to remember that each sum 

/iW + /*(*) +/•(*) + • • • 

is, by definition, the limit of the sequence 

/iW, /iW +M*)> AW +Mx) + /.(*), .... 
If we define a new sequence of functions { j n } by 

Jn = fi + ' ' ' + /», 
then we can express this fact more succinctly by writing 

/(*) = lim s n (x). 

n— *to 

For some time we shall therefore concentrate on functions defined as limits, 

/(*) = lim /„(*), 

rather than on functions defined as infinite sums. The total body of results 
about such functions can be summed up very easily: nothing one would hope 
to be true actually is — instead we have a splendid collection of counter- 
examples. The first of these shows that even if each f n is continuous, the func- 
tion / may not be ! Contrary to what you may expect, the functions f n will be 
very simple. Figure 1 shows the graphs of the functions 



/»(*) = j 



, 0 < x < 1 
1, x > 1. 
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FIGURE 2 




FIGURE 3 





/■ 




3 






2- 


A 




1- 


1 


\ A 






l 



These functions are all continuous, but the function f(x) = lim f n (x) is not 

n— » oo 

continuous; in fact, 

0, 0 < * < 1 



hm/ n (*) = | 1} x >\ m 



Another example of this same phenomenon is illustrated in Figure 2; the 
functions f n are defined by 



-1, x < - - 
n 

1 1 

AW = < nx, - - < x < - 
n n 



i, 



n 



In this case, if x < 0, then f n (x) is eventually (i.e., for large enough n) equal 
to -1, and if x > 0, then f n (x) is eventually 1, while / n (0) = 0 for all n. Thus 

[-1, *<0 
lim/ n W = (0, x = 0 
U, ^>0; 

so, once again, the function f(x) = lim f n (x) is not continuous. 

n— > oo 

By rounding off the corners in the previous examples it is even possible to 
produce a sequence of differ entiable functions \j n \ for which the function 
f(x) = lim/ n 0) is not continuous. One such sequence is easy to define 

n — * so 

explicitly: 



-1, 



n 



1, - <x. 

n 

These functions are differentiable (Figure 3), but we still have 
lim/ n (*) = 



-1, x < 0 
0, * = 0 

U, *>o. 



FIGURE 4 



Continuity and differentiability are, moreover, not the only properties for 
which problems arise. Another difficulty is illustrated by the sequence {/ n } 
shown in Figure 4; on the interval [0, \/n] the graph of f n forms an isosceles 
triangle of altitude n y while f n (x) = 0 for x > \/n. These functions may be 
defined explicitly as follows: 
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FIGURE 5 




FIGURE 6 



2n 2 x, 

AW = { 2n - 2n% 
0, 



0 < x < — 
- ~ 2n 

!<*<! 

2n n 



1 



< 1. 



Because this sequence varies so erratically near 0, our primitive mathe- 
matical instincts might suggest that lim f n (x) does not always exist. Never- 

n— » oo 

theless, this limit does exist for all x, and the function f(x) = lim /„(*) is even 

n — ► oo 

continuous. In fact, if x > 0, then /„(*) is eventually 0, so lim f n (x) = 0; 

n — ► oo 

moreover, / n (0) = 0 for all n, so that we certainly have lim / n (0) = 0. In 

n— ► oo 

other words, f(x) = lim f n {x) = 0 for all x. On the other hand, the integral 

n— > oo 

quickly reveals the strange behavior of this sequence; we have 

\q fn(x) dx = -J", 



but 
Thus, 



lim C fn(x) dx ^ r lim/ n (*) 

n— ^oo u •/ u n— » oo 



This particular sequence of functions behaves in a way that we really never 
imagined when we first considered functions defined by limits. Although it is 
true that 

f(x) = lim f n (x) for each x in [0, 1], 

n — * oo 

the graphs of the functions f n do not "approach" the graph of / in the sense of 
lying close to it — if, as in Figure 5, we draw a strip around /of total width 2e 
(allowing a width of e above and below), then the graphs of f n do not lie com- 
pletely within this strip, no matter how large an n we choose. Of course, for 
each x there is some N such that the point (x, f n (x)) lies in this strip for n > N; 
this assertion just amounts to the fact that lim f n (x) = f(x). But it is necessary 

71— > oo 

to choose larger and larger A^'s as x is chosen closer and closer to 0, and no one 
N will work for all x at once. 

The same situation actually occurs, though less blatantly, for each of the 
other examples given previously. Figure 6 illustrates this point for the sequence 



0 < x < 1 

X > 1. 



A strip of total width 2s has been drawn around the graph oif{x) = lim /„(*). 

n— * «j 

If e < this strip consists of two pieces, which contain no points with second 
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FIGURE 7 



DEFINITION 



THEOREM 1 



coordinate equal to -5-; since each function f n takes on the value -g-, the graph 
of each f n fails to lie within this strip. Once again, for each point x there is 
some N such that (x, fjx)) lies in the strip for n > N; but it is not possible to 
pick one TV which works for all x at once. 

It is easy to check that precisely the same situation occurs for each of the 
other examples. In each case we have a function /, and a sequence of functions 
{f n }, all defined on some set A, such that 

f(x) — Km f n {x) for all x in A. 

This means that 

for all e > 0, and for all x in A, there is some N such that if n > N 9 
then \f(x) -/»(*) I < e. 

But in each case different N's must be chosen for different x% and in each case 
it is not true that 

for all £ > 0 there is some N such that for all x in A, if n > N, then 

l/W - AMI < «. 

Although this condition differs from the first only by a minor displacement 
of the phrase "for all x in A," it has a totally different significance. If a 
sequence {/„} satisfies this second condition, then the graphs of/ n eventually 
lie close to the graph of /, as illustrated in Figure 7. This condition turns out to 
be just the one which makes the study of limit functions feasible. 



Let \f n ] be a sequence of functions defined on A, and let / be a function 
which is also defined on A. Then / is called the uniform limit of {/„ } on A 
if for every £ > 0 there is some N such that for all x in A, 

ifn> N, then |/(*) -/«(*)! < 8- 

We also say that {f n } converges uniformly to /on A, or that f n approaches 
/ uniformly on A. 



As a contrast to this definition, if we know only that 
f(x) = lim f n (x) for each x in A, 

71— > 00 

then we say that {/ M } converges pointwise to /on A, Clearly, uniform con- 
vergence implies pointwise convergence (but not conversely!). 

Evidence for the usefulness of uniform convergence is not at all difficult to 
amass. Integrals represent a particularly easy topic; Figure 7 makes it almost 
obvious that if {f n \ converges uniformly to /, then the integral of f n can be 
made as close to the integral of /as desired. Expressed more precisely, we have 
the following theorem. 

Suppose that {/„} is a sequence of functions which are integrable on [a, b], 
and that {/ n } converges uniformly on [a, b] to a function /which is integrable 
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on [a, b]. Then 

PROOF Let e > 0. There is some N such that for all n > N we have 

l/to ~ /ntol < S for all * in [a, b]. 
Thus, if n > N we have 

| f*f(x) dx - f a b f n (x) dx\ = \ /; [f(x) - /„(,)] dx I 

* //l/W -/»(*)!<& 

< f\dx 
= £(A - a). 
Since this is true for any £ > 0, it follows that 

/ 0 V=lim/>| 

The treatment of continuity is only a little more difficult, involving an 
"s/3-argument," a three-step estimate of \f(x) - f(x + ti)\. If {f n \ is a 
sequence of continuous functions which converges uniformly to /, then there 
is some n such that 

(1) l/to -/nto| < J 

(2) |/(*-M) ~/n(* + A)| <|. 

Moreover, since f n is continuous, for sufficiently small h we have 

(3) l/nto -/n(* + *)| <|- 

It will follow from (1), (2), and (3) that |/(*) - f(x + h)\ < e. In order to 
obtain (3), however, we must restrict the size of \h\ in a way that cannot be 
predicted until n has already been chosen; it is therefore quite essential that 
there be some fixed n which makes (2) true, no matter how small \h\ may be — 
it is precisely at this point that uniform convergence enters the proof. 

THEOREM 2 Suppose that {/ n } is a sequence of functions which are continuous on [a, b] 9 
and that {/ n } converges uniformly on [a, b] to /. Then /is also continuous on 
[«,*]• 

PROOF For each x in [a, b] we* must prove that / is continuous at x. We will deal only 
with x in (a, b) ; the cases x = a and x = b require the usual simple modi- 
fications. 
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Let e > 0. Since {/„} converges uniformly to / on [a, b], there is some n 
such that 

\f{y) -/.Ml <| for all >in [a,*]. 
In particular, for all h such that x + h is in [a, b], we have 

(1) |/(*) -/ B (*)| <|. 

(2) |/(* + A) -/„(* + A) | <|- 

Now /„ is continuous, so there is some 8 > 0 such that for |A| < S we have 

(3) |/nW -/„(* + A)| <|- 

Thus, if |A| < 5, then 

|/(* + A) -/Ml 

= |/(* + A) — /„(* + h) + /„(* + h) - /„(*) + /»(*) - /(at) | 
< |/(* + A) - /»(* + A) I + l/»(* + h) - /»(*)! + |/»to ~ /(*)| 

s , s , s 
< 3 + I + 3 



This proves that / is continuous at *. | 



FIGURE 8 



After the two noteworthy successes provided by Theorem 1 and Theorem 2, 
the situation for differentiability turns out to be very disappointing. If each 
f n is differentiate, and if }/ n } converges uniformly to /, it is still not neces- 
sarily true that / is differentiate. For example, Figure 8 shows that there is a 
sequence of differentiable functions {/ n } which converges uniformly to the 
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function f(x) = |*|. Even if / is differentiable, it may not be true that 

/'(*) = Hm /.'(*); 

this is not at all surprising if we reflect that a smooth function can be approxi- 
mated by very rapidly oscillating functions. For example (Figure 9), if 

fn(x) = -sin(rc 2 #), 
n 

then {f n } converges uniformly to the function /(*) = 0, but 

fn(x) = n cos(n 2 x), 

and lim n cos(w 2 *) does not always exist (for example, it does not exist if 

n — ► oo 

x = 0). 




n 



FIGURE 9 

Despite such examples, the Fundamental Theorem of Calculus practically 
guarantees that some sort of theorem about derivatives will be a consequence 
of Theorem 1; the crucial hypothesis is that {//} converge uniformly (to 
some continuous function). 

theorem 3 Suppose that {f n } is a sequence of functions which are differentiable on 
[a,b\ and that {/ n } converges (pointwise) to /. Suppose, moreover, that 
{fn} converges uniformly on [a, b] to some continuous function g. Then / is 
differentiable and 

/'(*) - lim /„'(*). 

n— ► oo 

PROOF Applying Theorem 1 to the interval [a, x], we see that for each x we have 

= lim [/„(*) - /„(*)] 
= fix) - f(a). 
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Since p is continuous, it follows that f{x) = g(x) = lim f n (x) for all x in 

0 x—* *> 

the interval [a, b]. | 

Now that the basic facts about uniform limits have been established, it is 
clear how to treat functions defined as infinite sums, 

/« =/iW +/2W + /»(*) + * ' * • 
This equation means that 

/(*) = lim/i(jr) + • • • +/„W; 

n— > oo 

our previous theorems apply when the new sequence 

/i,/i+/2,A +/«+/* • ■ ■ 

converges uniformly to /. Since this is the only case we shall ever be inter- 
ested in, we single it out with a definition. 



DEFINITION 



The series £ /„ converges uniformly (more formally: the sequence {f n \ 

n = 1 

is uniformly summable) to / on A, if the sequence 

+/»+/•■ • • • 

converges uniformly to / on A. 



We can now apply each of Theorems 1, 2, and 3 to uniformly convergent 
series; the results may be stated in one common corollary. 



oo 

COROLLARY Let ^ f n converge uniformly to /on [a, b]. 



(1) If each f n is continuous on [a, b], then / is continuous on [a, b\ 

(2) If / and each f n is integrable on [a, b], then 

/:/=!/> 

n = l 

00 

Moreover, if T / n converges (pointwise) to / on [a, ft], and £ fn converges 

uniformly on [a, b] to some continuous function, then 

00 

(3) fix) - ^ for aU * in [a ' bl 
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PROOF (1) If each/ n is continuous, then so is each /i + • • • + /n, and /is the 

uniform limit of the sequence f h /i + f 2 , fi + /2 +/s, . . . , so /is 
continuous by Theorem 2. 
(2) Since /i, /i + / 2 , /i + / 2 + / 3} . . . converges uniformly to /, it 
follows from Theorem 1 that 



///.to /.'</, + •■•+/.) 

-«-(/>+••■ +/;/.) 

00 



(3) Each function /i + • • • + / n is differentiable, with derivative 
' • ; + /»', and //, /i' + / 2 ', / x ' + /,' + /,', . . • con- 
verges uniformly to a continuous function, by hypothesis. It follows 
from Theorem 3 that 

/'(*) = lim [//(*)+ • • • +/„'(*)] 

n— ► oo 

00 

= 2 /.'w. i 

n = 1 

At the moment this corollary is not very useful, since it seems quite difficult 
to predict when the sequence /i, /i + / 2 , /i + / 2 + / 3 , . . . will converge 
uniformly. The most important condition which ensures such uniform con- 
vergence is provided by the following theorem; the proof is almost a triviality 
because of the cleverness with which the very simple hypotheses have been 
chosen. 

THEOREM 4 Let {f n \ be a sequence of functions defined on A, and suppose that {M n } is a 
(THE WEIERSTRASS M-TEST) sequence of numbers such that 

\fn(x)\ < M n for all x in A. 

CO 

Suppose moreover that T M n converges. Then for each x in A the series 
« = i 

oo 00 

£ fn(x) converges (in fact, it converges absolutely), and ^ f n converges 

n~l n== 1 

uniformly on A to the function 

00 

/(*) = I /.(*). 

n = 3 

PROOF For each x in A the series ^ |/nW| converges, by the comparison test; 
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fM = i(2*i 



(a) 



/.to = 



1 



(b) 



FIGURE 11 



consequently ^ /„(*) converges (absolutely). Moreover, for all x in ^ we have 

n = 1 

00 

i/w - [/iw + • • • +/-WH = I 2 /»w I 

< f 1/nWI 
n = 7?+l 

00 

< I M n . 

00 00 

Since Y M n converges, the number Y Af n can be made as small as 
desired, by choosing TV sufficiently large. | 




FIGURE 10 



The following sequence {/ n } illustrates a simple application of the Weier- 
strass M-test. Let {*} denote the distance from x to the nearest integer (the 
graph of /(*) = {x} is illustrated in Figure 10). Now define 

/.W -iJ: 

The functions f x and / 2 are shown in Figure 11 (but to make the drawings 
simpler, 10 n has been replaced by 2 n ). This sequence of functions has been 
defined so that the Weierstrass M-test automatically applies: clearly 

|/«Ml<^ for all*, 

00 * 

and ^ V10 n converges. Thus £ f n converges uniformly; since each /« is 
continuous, the corollary implies that the function 
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is also continuous. Figure 12 shows the graph of the first few partial sums 
fi + * * • + / n . As n increases, the graphs become harder and harder to 

so 

draw, and the infinite sum ^ f n is quite undrawable, as shown by the follow- 

n — 1 

ing theorem (included mainly as an interesting sidelight, to be skipped if you 
find the going too rough). 



THEOREM 5 The function 



PROOF 



/w = tro"» {10 "* } 

n — l 

is continuous everywhere and differentiable nowhere ! 

We have just shown that /is continuous; this is the only part of the proof which 
uses uniform convergence. We will prove that / is not differentiable at a, for 
any <z, by the straightforward method of exhibiting a particular sequence 
{h m } approaching 0 for which 

lim f(a + hm) ~ f{a) 

m-K» h m 

does not exist. It obviously suffices to consider only those numbers a satisfying 
0 < a< 1. 

Suppose that the decimal expansion of a is 

a = 0.<Zi<22<23tf4 .... 

Let h m = 10~ m if a m ^ 4 or 9, but let k m = -10~ m if a m = 4 or 9 (the reason 
for these two exceptions will appear soon). Then 



f(a + h m ) - f(a) 



10 



\lO n (a + h m )} - {10 n a} 



±10~ m 

± i<r-*[{io*(a + h m )} - {I0 n a}l 



This infinite series is really a finite sum, because if n > m, then 10 n h m is an 
integer, so 

{10 n (a + h m )\ - \10 n a] - 0. 
On the other hand, for n < m we can write 

10 n a = integer + 0.a n+ ia n+2 a n +3 . . • a m . . • 
10 n (a + h m ) = integer + 0.a n+ ia n +2a n +3 . . . (a m ± 1) • • • 

(in order for the second equation to be true it is essential that we choose 
h m ~ — 10 -m when a m = 9). Now suppose that 

«m • • • 2 • 
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/!+/.+/• 




/l+/.+/l+/4 



Then we also have 

O.0 n +i<Z n + 2 0n+3 . . - (flm + 1) • • • ^ i 

(in the special case m = n + 1 the second equation is true because we chose 
h m = -10" m when a m = 4). This means that 

{10"(fl + A»)| - {10"*} = ±10*-™, 
and exactly the same equation can be derived when 0.a n+ ia n -^2a n+ 3 . . . > h 
Thus, for n < m we have 

\0 m - n [{\0*(a + k m )\ - {10M] = ±1- 

In other words, 

f(a + k m ) - f(a) 
h m 

is the sum of m - 1 numbers, each of which is ± 1. Now adding +1 or — 1 
to a number changes it from odd to even, and vice versa. The sum of m - 1 
numbers each ± 1 is therefore an even integer if m is odd, and an odd integer if m 
is even. Consequently the sequence of ratios 

f(a + h m ) -f(a) 

h m 

cannot possibly converge, since it is a sequence of integers which are alter- 
nately odd and even. | 

In addition to its role in the previous theorem, the Weierstrass M-test is an 
ideal tool for analyzing functions which are very well behaved. We will give 
special attention to functions of the form 




/(*) 



a n (x - a) n , 



which can also be described by the equation 

/to = 

for f n (x) = a n {x - a) n . Such an infinite sum, of functions which depend only 
on powers of (* - a), is called a power series centered at a. For the sake of 
simplicity, we will usually concentrate on power series centered at 0, 

eo 

/(*) = £ a n x\ 

n=0 

One especially important group of power series are those of the form 

n = 0 
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where / is some function which has derivatives of all orders at a; this series is 
called the Taylor series for / at a. Of course, it is not necessarily true that 

/W- tea (*-«)•; 

71 = 0 

this equation holds only when the remainder terms satisfy lim R n A x ) — 0. 

n—+ as 

We already know that a power series ^ a n x n does not necessarily converge 

n = 0 

for all x. For example the power series 

X 3 t X b X 7 , 

converges only for |#| < 1, while the power series 

# 2 , # 3 * 4 . x h , 
# ^ . 

2 3 4 5 

converges only for — 1 < x < 1 . It is even possible to produce a power series 
which converges only for x = 0, For example, the power series 



i\x n 



does not converge for x ^ 0; indeed, the ratios 
(n + l)!(* n+1 ) 



nix 



= (n + \)x 



are unbounded for any x 9* 0. If a power series ^ a n x n does converge for 

n = 0 

00 

some #0^0 however, then a great deal can be said about the series ^ a n x n 



for |*| < |# 0 |. 
theorem 6 Suppose that the series 



/Oo) = ^ ^n^0 n 



converges, and let <z be any number with 0 < a < \x 0 \. Then on [ — a, a] the 
series 

00 

/(*) = £ 
n = 0 

converges uniformly (and absolutely). Moreover, the same is true for the 
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series 



na n x " 



« = i 

Finally, / is differentiable and 

/'(*) = J nawX ^ 1 

n = 1 

for all x with |x| < |* 0 |- 

00 

PROOF Since £ tf n * 0 n converges, the terms tf n * 0 n approach 0. Hence they are surely 

71 = 0 

bounded: there is some number Af such that 

|a n *o n | = \a n \ • |x 0 n | < M for all n. 
Now if * is in [ — a, a], then |*| < \a\, so 



|<z«* n | = \a n \ ' \x n \ 

< \On\ • i^l 



= |«n| * |*0] 

< Af 



I Xq I 



(this is the clever step) 



0 I 



But \a/x 0 \ < 1, so the (geometric) series 



n = 0 



converges. Choosing Af ■ \a/x 0 \ n as the number Af n in the Weierstrass Af-test, 

CO 

it follows that ^ a n x n converges uniformly on [-a, a]. 

n = 0 

op 

To prove the same assertion for g(x) = ^ wa n ^ n_1 notice that 



n = l 
n-l| 



< «W • \a 
._ W . u |» „ | ± r 







Af 1 a 






< 


n «!- 




Af 




M \ 


A j a 








n — 






= h„4 





Since \a/x 0 \ < 1, the series 



converges (this fact was proved in Chapter 22 as an application of the ratio 
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test). Another appeal to the Weierstrass M-test proves that ^ na n x n 1 con- 

n-l 

verges uniformly on [— a, a). 

Finally, our corollary proves, first that g is continuous, and then that 

/'(*) = g(x) = £ na n x n ~ l for x in [-a, a]. 

n = 1 

Since we could have chosen any number a with 0 < a < \x 0 \, this result holds 
for all x with \x\ < |x 0 |. I 

Theorem 6, applied to the infinite series 

x* x^ x 7 . * 9 

sin x = x • • • , 

3! 5! 7! 9! 

X 2 , X 4 X* , X 8 

cos X — 1 — • • ' , 

2! 4! 6! 8! 

X x^ x^ x^ 

eX = 1 + v + v + Ti + 4i + -'-> 

yields precisely the results which are expected. Each of these converges for any 
#o, hence the conclusions of Theorem 6 apply for any x: 

3x 2 5x i 

sin'(*) = 1 - — + — - • • • = cos x, 

„ , 2x 4x* 6x> 
cos'(x) = - — + —- —-+••• = - sin x, 
21 41 61 

2x 3>x 2 

exp'(*) = 1 + — + — +*•' = exp(x). 

For the functions arctan and f(x) - log(l + x) the situation is only slightly 
more complicated. Since the series 

^3 j£\> ^7 

arctan x ~ x 1 — + ■ ' • 

3 5 7 

converges for x 0 = 1, it also converges for \x\ < 1, and 

arctan'M = 1 - x 2 + x* - x« + ■ • • = —J— for |x| < 1. 

1 + x 2 

In this case, the series happens to converge for x = —1 also. However, the 
formula for the derivative is not correct for x = 1 or x = — 1; indeed the 
series 

1 - x 2 + x* - * 6 + • • • 

diverges for x = 1 and x = — 1 . Notice that this does not contradict Theorem 
6, which proves that the derivative is given by the expected formula only for 

\x\ < \xo\. 
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Since the series 



log(l + ,)^-| + |-|+| 



converges for x 0 = 1, it also converges for |#| < 1, and 
1 



1 + * 



= log'(l + x) = 1 - x + x 2 - * 3 + • " • for \x\ < 1. 



In this case, the original series does not converge for x = — 1 ; moreover, the 
differentiated series does not converge for x = 1 . 

All the considerations which apply to a power series will automatically 
apply to its derivative, at the points where the derivative is represented by a 
power series. If 

00 

/(*) = I a n x» 

71 = 0 

converges for all x in some interval (—R,R), then Theorem 6 implies that 

f{x) = y na n x n ~i 

n-l 

for all * in (—R 9 R). Applying Theorem 6 once again we find that 

00 

/"(*) = J »(» - IK*" -2 , 

n = 2 

and proceeding by induction we find that 

oo 

/<*>(*) = J n(n - 1) • • • (« - k + IK**"*. 

Thus, a function defined by a power series which converges in some interval 
( — R,R) is automatically infinitely differentiable in that interval. Moreover, 
the previous equation implies that 

/<*>(0) - k\a k3 

so that 

/<*>(0) 



A! 



In other words, a convergent power series centered at 0 is always the Taylor series at 0 
of the function which it defines. 

On this happy note we could easily end our study of power series and 
Taylor series. A careful assessment of our situation will reveal some un- 
explained facts however. 

The Taylor series of sin, cos, and exp are as satisfactory as we could desire; 
they converge for all #, and can be differentiated term-by-term for all x. The 
Taylor series of the function f(x) = log(l + x) is slightly less pleasing, because 
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it converges only for — 1 < x < 1, but this deficiency is a necessary conse- 
quence of the basic nature of power series. If the Taylor series for / converged 
for any x 0 with |# 0 I > 1, then it would converge on the interval ( — 1* 0 [, |*o|), and 
on this interval the function which it defines would be differentiable, and thus 
continuous. But this is impossible, since it is unbounded on the interval 
( — 1, 1), where it equals log(l + x). 

The Taylor series for arctan is more difficult to comprehend — there seems 
to be no possible excuse for the refusal of this series to converge when \x\ > 1. 
This mysterious behavior is exemplified even more strikingly by the function 
f(x) = 1/(1 + x 2 ), an infinitely differentiable function which is the next best 
thing to a polynomial function. The Taylor polynomial of / is given by 

/(*) = 7-7— ; i = 1 ~ * 2 + * 4 - * 6 + x * ~ ' ' ' • 

1 + x 2 

If \x\ > 1 the Taylor series does not converge at all. Why? What unseen 
obstacle prevents the Taylor series from extending past 1 and —1? Asking 
this sort of question is always dangerous, since we may have to settle for an 
unsympathetic answer: it happens because it happens — that's the way things 
are ! In this case there does happen to be an explanation, but this explanation 
is impossible to give at the present time; although the question is about real 
numbers, it can be answered intelligently only when placed in a broader 
context. It will therefore be necessary to devote two chapters to quite new 
material before completing our discussion of Taylor series in Chapter 26. 



PROBLEMS 
1 



For each of the following sequences {/ n }, determine the pointwise limit 
of {f n \ (if it exists) on the indicated interval, and decide whether {f n } 
converges uniformly to this function. 



(i) /nW 


= Vx, 


(ii) fn(x) 




o, 

x — 


(iii) /«(*) 


e z 

= — j c 
x n 


(iv) f(x) 


= e 


—nx* 

5 


(v) f(x) 


e 


-x* 

j 

n 



x < n 



on [a, b], and on R. 



on R. 

2- Find the Taylor series at 0 for each of the following functions. 
1 



(i) fix) = 



a 9^0. 



x — a 

(ii) /(*) = log(* - a), a* 0. 
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(iii) /(*) = 1 - (1 - *)- 1/2 . (Use Problem 19-6.) 
V 1 — x 

( v ) /(*) = arcsin x. 

3. Find each of the following infinite sums. 

y.2 V>3 y«4 

(ii) i _ *3 + _ x s + . . . § Hint: What is 1 - * + * 2 - * 3 + • * * ? 

(iii) ^! - — + — — + • • • for W < 1. Hint: Differentiate. 

3-2 4-3 5-4 

v i ^ i , J L±... 1 

(1VJ FT 3-2^4-3 5 • 4 ' [ (See Problem 10.) 

4. If /W = (sin *)A for * ^ 0 and /(0) = 1, find / (A) (0). Hint: Find the 
power series for /. 

5. In this problem we deduce the binomial series (1 + x) a = ^ * n , 

n = 0 

|*| < 1 without all the work of Problem 22-16, although we will use a 
fact established in part (a) of that problem — the series ^ x n does 

n = 0 

converge for |*| < 1. 

(a) Prove that (1 + *)/'(*) = af(x) for [x| < 1. 

(b) Now show that any function / satisfying part (a) is of the form 
f(x) = c(l + x) a for some constant c, and use this fact to establish 
the binomial series. Hint: Consider g(x) = f(x)/(l + x) a . 

CO 

6. (a) Suppose that /(*) = £ anX " conver S es for a11 * in some interval 

n = 0 

(-R,R) and that /(*) = 0 for all x in (-/?, R). Prove that each 
<z n = 0. (If you remember the formula for a n this is easy.) 
(b) Suppose we know only that /(*») = 0 for some sequence {x n } with 
lim x n = 0. Prove again that each a n = 0. Hint: First show that 

71— ► 00 

f(0) = ao = 0; then that /'(0) = ai = 0, etc. 

This result shows that if f(x) = e~ 1/xt sin 1 /x for * 5* 0, then / cannot 
possibly be written as a power series. It also shows that a function 
defined by a power series cannot be 0 for x < 0 but nonzero for 
x > 0 — thus a power series cannot describe the motion of a particle 
which has remained at rest until time 0, and then begins to move ! 



430 Infinite Sequences and Infinite Series 



(c) Suppose that /(*) = £ a n x n and g(x) = V b n x n converge for all x 

n=0 n=0 

in some interval containing 0 and that f(t m ) = £(/ m ) for some 
sequence {t m } converging to 0. Show that a n = b n for each n. In 
particular, a function can have only one representation as a power series 
centered at 0. 

00 

7. Prove that if /W = ^ a n * n is an even function, then <z n = 0 for n odd, 

n = 0 

and if / is an odd function, then a n = 0 for n even. 
*8. Recall that the Fibonacci sequence {a n \ is defined by ai = a 2 = 1, 
tf n+ i = a n + a n -i. 

(a) Show that a n+1 /a n < 2. 

(b) Let 

00 

/to = 2 *n* B_l = 1 + * + 2* 2 + 3* 3 + • • • . 

n = 1 

Use the ratio test to prove that /(*) converges if |*| < 1/2. 

(c) Prove that if |4 < 1/2, then 

fix) = 



a: 2 + x - 1 



Hint: This equation can be written /(*) - xf(x) - x 2 f(x) = 1. 

(d) Use the partial fraction decomposition for I/O 2 + x - 1), and the 
power series for l/(x - a), to obtain another power series for /. 

(e) It follows from Problem 6 that the two power series obtained for / 
must be the same. Use this fact to show that 



a n — r ~ 
V5 

9. Show that the power series for /(*) = log(l — x) converges only for 
-1 < x < 1, and that the power series for g (x) = log[(l + x)/(l - x)] 
converges only for a: in ( — 1, 1). 

* 00 

*10. Suppose that £ a n converges. We know that the series f(x) = Y a n x n 
n =o n =o 
must converge uniformly on [-a, a] for 0 < a < 1, but it may not 
converge uniformly on [- 1, 1]; in fact, it may not even converge at the 
point -1 (for example, if f(x) = log(l + x)). However, a beautiful 
theorem of Abel shows that the series does converge uniformly on [0, 1]. 

00 

Consequently, / is continuous on [0, 1] and, in particular, ^ a n = 
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Km 7 a n x n . Prove Abel's Theorem by noticing that if \a m + • • • + a n \ 

< e, then \a m x m + ' ■ • + 0n* n | < e, by Abel's Lemma (Problem 
21-20). 

11. A sequence {a n } is called Abel summable if hm £ exists; Problem 

10 shows that a summable sequence is necessarily Abel summable. Find 
a sequence which is Abel summable, but which is not summable. Hint: 
Look over the list of Taylor series until you find one which does not con- 
verge at 1, even though the function it represents is continuous at 1. 

12. In Theorem 3 we assumed only that {/» } converges pointwise to/. Show 
that the remaining hypotheses ensure that {/ n } actually converges 
uniformly to /. 

13. (a) Suppose that |/ n J is a sequence of bounded (not necessarily con- 

tinuous) functions on [a, b] which converge uniformly to / on [a 9 b]. 

Prove that / is bounded on [a, b\ 
(b) Find a sequence of continuous functions on [a, b] which converge 

pointwise to an unbounded function on [a, b]. 
*14. Suppose that/is differentiate. Prove that the function/ is the pointwise 
limit of a sequence of continuous functions. (Since we already know 
examples of discontinuous derivatives, this provides another example 
where the pointwise limit of continuous functions is not continuous.) 

15. Find a sequence of integrable functions {/„} which converges to the 
(nonintegrable) function / that is 1 on the rationals and 0 on the irra- 
tionals. Hint: Each f n will be 0 except at a few points. 

16. This problem outlines a completely different approach to the integral; 
consequently, it is unfair to use any facts about integrals learned 
previously. 

(a) Let s be a step function on [a, b\ so that s is constant on (/ t -_i, ft) for 

some partition {* 0> ...,'»} of [a, b]. Define f* s as £ - 

i=i 

where Si is the (constant) value of s on (U-i, k). Show that this 
definition does not depend on the partition {t 0 , . . . 

(b) A function / is called a regulated function on [a, b] if it is the uniform 
limit of a sequence of step functions {* n } on [a, b\ Show that in this 
case there is, for every e > 0, some N such that for m, n > N we have 
\s n (x) - Sm(x)\ < S for all x in [a, b\ 

(c) Show that the sequence of numbers { f* s n } will be a Gauchy sequence. 

(d) Suppose that {*„} is another sequence of step functions on [a, b] 
which converges uniformly to /. Show that for every £ > 0 there is 
an N such that for n > N we have \s n (x) - t n (x)\ < £ for x in [a, b\. 

(e) Conclude that lim f & s n - lim /* t n . This means that we can 



define [* f to be lim f h s n for any sequence of step functions {j- n } 

converging uniformly to /. The only remaining question is: Which 
functions are regulated? Here is a partial answer. 
*(f) Prove that a continuous function is regulated. Hint: To find a step 
function s on [a, b] with \f(x) — s(x)\ < 6 for all x in [a, b\ consider 
all y for which there is such a step function on [a, y]. 

Find a sequence {f n \ approaching / uniformly on [0, 1] for which 
lim (length of f n on [0, 1]) ^ length of /on [0, 1]. (Length is defined in 

n—* oo 

Problem 15-32, but the simplest example will involve functions the 
length of whose graphs will be obvious.) 



CHAPTER 




COMPLEX NUMBERS 



With the exception of the last few paragraphs of the previous chapter, this 
book has presented unremitting propaganda for the real numbers. Neverthe- 
less, the real numbers do have a great deficiency — not every polynomial 
function has a root. The simplest and most notable example is the fact that no 
number x can satisfy x 2 + 1 =0. This deficiency is so severe that long ago 
mathematicians felt the need to "invent" a number i with the property that 
{2 + i = o. For a long time the status of the "number" i was quite mysterious: 
since there is no number x satisfying x 2 + 1 = 0, it is nonsensical to say "let 
i be the number satisfying i 2 + 1 = 0." Nevertheless, admission of the 
"imaginary" number i to the family of numbers seemed to simplify greatly 
many algebraic computations, especially when "complex numbers" a + bi 
(for a and b in R) were allowed, and all the laws of arithmetical computation 
enumerated in Chapter 1 were assumed to be valid. For example, every 
quadratic equation 

ax 2 + bx + c = 0 {a ^ 0) 

can be solved formally to give 

-b + Vb 2 - Aac -b - Vb 2 - Aac 

x = or x = " 

2a 2a 

Ifb 2 — Aac > 0, these formulas give correct solutions; when complex numbers 
are allowed the formulas seem to make sense in all cases. For example, the 
equation 

x 2 + x+\ = 0 

has no real root, since 

x 2 + x + 1 = (x + i) 2 + f > 0, for all x. 
But the formula for the roots of a quadratic equation suggest the "solutions" 

x = and x = ; 

2 2 

if we understand to mean V3 • (-1) - V?> • V-l = VI i, then 

these numbers would be 

1 , V3. . 1 V3 . 
i and — — i. 

2 2 2 2 

It is not hard to check that these, as yet purely formal, numbers do indeed 
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satisfy the equation 

* 2 + * + 1 = 0. 

It is even possible to "solve" quadratic equations whose coefficients are them- 
selves complex numbers. For example, the equation 

x 2 + x + 1 + i - 0 

ought to have the solutions 



-1 ± Vl - 4(1 + 0 -1 ± V-3 - 4i 

* = ~ = 2 ' 

where the symbol — 4i means a complex number a + fit whose 

square is — 3 — 4i. In order to have 

(a + #) 2 = a 2 - P 2 + 2aPi = -3 - 4i 

we need 

a 2 - 0 2 = -3, 

2a0 = -4. 

These two equations can easily be solved for real a and /3; in fact, there are 
two possible solutions: 

a = 1 , a — — 1 

0.-2 and /3 = 2. 

Thus the two "square roots" of —3 — 4i are 1 — 2i and —1 + 2 i. There i s 
no reasonable way to decide which one of these should be called V — 3 — 4*', 
and which — — 4z ; the conventional usage of V# makes sense only for 

real x > 0, in which case V* denotes the (real) nonnegative root. For this 
reason, the solution 

-1 ± V-3 - 4i 

X = — 2 

must be understood as an abbreviation for: 
— 1 + r 

^ — _ , where r is one of the square roots of —3 — 4i. 

With this understanding we arrive at the solutions 

-l + l-2i 

* - = 

— 1 — 1 + 2» 1 . 

* = 2 = 

as you can easily check, these numbers do provide formal solutions for the 
equation 

x 2 + x + 1 + i = 0. 
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For cubic equations complex numbers are equally useful. Every cubic 
equation 

ax z + bx 2 + cx + d = 0 (a 5* 0) 

with real coefficients a, b, c, and d, has, as we know, a real root a, and if we 
divide ax z + bx 2 + cx + d by x — a we obtain a second-degree polynomial 
whose roots are the other roots of ax z + bx 2 + cx + d = 0; the roots of this 
second-degree polynomial may be complex numbers. Thus a cubic equation 
will have either three real roots or one real root and 2 complex roots. The 
existence of the real root is guaranteed by our theorem that every odd degree 
equation has a real root, but it is not really necessary to appeal to this theorem 
(which is of no use at all if the coefficients are complex); in the case of a cubic 
equation we can, with sufficient cleverness, actually find a formula for all the 
roots. The following derivation is presented not only as an interesting illustra- 
tion of the ingenuity of early mathematicians, but as further evidence for the 
importance of complex numbers (whatever they may be). 

To solve the most general cubic equation, it obviously suffices to consider 
only equations of the form 

x* + bx 2 + cx + d - 0. 

It is even possible to eliminate the term involving x 2 , by a fairly straight- 
forward manipulation. If we let 

b 

x = y — -» 



then 



so 

0 = x z + bx 2 + cx + d 



The right-hand side now contains no term with^ 2 . If we can solve the equation 
for y we can find x; this shows that it suffices to consider in the first place only 
equations of the form 

x z + px + q - 0. 

In the special case p = 0 we obtain the equation x z = — q. We shall see later 
on that every complex number does have a cube root, in fact it has three, so 
that this equation has three solutions. The case p ^ 0, on the other hand, 
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requires quite an ingenious step. Let 

P_ 
3w 



Then 



0 = * 3 +px + q = (w - +p(w + q 

3w 2 p 3wp 2 p z s p 2 



w° — 



+ — V bw — ~ V q 

2>w 9w 2 27 w* F 3w 



This equation can be written 

27(> 3 ) 2 + 27q(w*) - p 3 = 0, 

which is a quadratic equation in w z (!!). 
Thus 



= -27? ± V(27)V + 4 • Hp* 
2 • 27 



2 ~ * 4 + 27 



Remember that this really means: 



^ + r, where r is a square root of + • 
2 4 27 



We can therefore write 



^9 'A 97' 



27 7 

this equation means that if is some cube root of — q/2 + r, where r is some 
square root of q 2 /4 + p 3 /27. This allows six possibilities for w, but when these 
are substituted into (*), yielding 

3/" 



= ^Zl ± Jt^I p 

* 2 M 27 3 _„ 



^ 2 " V 4 27 

it turns out that only 3 different values for x will be obtained ! An even more 
surprising feature of this solution arises when we consider a cubic equation 
all of whose roots are real; the formula derived above may still involve com- 
plex numbers in an essential way. For example, the roots of 

x z - 15* - 4 = 0 

are 4, -2 + VJ, and -2 - V3. On the other hand, the formula derived 
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above (with p = — 15, q = — 4) gives as one solution 

-15 



x = </l + V4 - 125 



3 ' ^2 + V4 - 125 



= ^2 + 11/ + 



15 



3 • </i + 11/ 



Now, 



(2 + /) 3 = 2 3 + 3 • 2 2 / + 3 • 2 • / 2 + / 3 
= 8 + 122 — 6 — 2 
= 2 + Hi, 

so one of the cube roots of 2 + 11 £ is 2 + /.Thus, for one solution of the equation 
we obtain 

x = 2 + i + 



= 2 + / + 
= 2 + t + 



6 + 3/ 

15 6 - 3i 



6 + 3* 6 - 3t 
90 - 45/ 



36 + 9 
= 4(0. 

The other roots can also be found if the other cube roots of 2 + 11/ are 
known. The fact that even one of these real roots is obtained from an expres- 
sion which depends on complex numbers is impressive enough to suggest that 
the use of complex numbers cannot be entirely nonsense. As a matter of fact, 
the formulas for the solutions of the quadratic and cubic equations can be 
interpreted entirely in terms of real numbers. 

Suppose we agree, for the moment, to write all complex numbers as a + bi, 
writing the real number a as a + Oi and the number / as 0 + If. The laws 
of ordinary arithmetic and the relation i 2 = — 1 show that 

(a + bi) + (c + di) = {a + c) + (b + d)h 
(a + bi) ' (c + di) - (ac - bd) + {ad + bc)i. 

Thus, an equation like 

(1 + 2f) • (3 + If) = 1+7/ 

may be regarded as simply an abbreviation for the two equations 

1 • 3 - 2 • 1 = 1, 
1-1+2.3 = 7. 

The solution of the quadratic equation ax 2 + bx + c = 0 with real coefficients 
could be paraphrased as follows: 

u 2 _ v 2 = b 2 _ 4aCj 



If ' UV = 0, 

(i.e., if (ii + vi) 2 « b 2 - 4*;), 
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then 



«[(■ 

•H 



-b + u 



2a 

-b + u 



+ c = 0, 



DEFINITION 



It is not very hard to check this assertion about real numbers without 
writing down a single C£ z'," but the complications of the statement itself should 
convince you that equations about complex numbers are worthwhile as 
abbreviations for pairs of equations about real numbers. (If you are still not 
convinced, try paraphrasing the solution of the cubic equation.) If we really 
intend to use complex numbers consistently, however, it is going to be neces- 
sary to present some reasonable definition. 

One possibility has been implicit in this whole discussion. All mathematical 
properties of a complex number a + bi are determined completely by the real 
numbers a and b; any mathematical object with this same property may 
reasonably be used to define a complex number. The obvious candidate is the 
ordered pair (a, b) of real numbers; we shall accordingly define a complex 
number to be a pair of real numbers, and likewise define what addition and 
multiplication of complex numbers is to mean. 



A complex number is an ordered pair of real numbers; if z = (a, b) is a 
complex number, then a is called the real part of z, and b is called the 
imaginary part of z. The set of all complex numbers is denoted by C. If 
(a, b) and (c, d) are two complex numbers we define 

b) + (c, d) = (a + c y b + d) 
(a, b) - (c, d) — (a ' c — b • d, a • d + b • c). 

(The + and * appearing on the left side are new symbols being defined, 
while the + and ■ appearing on the right side are the familiar addition and 
multiplication for real numbers.) 



When complex numbers were first introduced, it was understood that real 
numbers were, in particular, complex numbers; if our definition is taken 
seriously this is not true — a real number is not a pair of real numbers, after 
all. This difficulty is only a minor annoyance, however. Notice that 

(a, 0) + (*, 0) = {a + b, 0 + 0) = (a + b } 0), 
(a, 0) • (b, 0) = (a ■ b - 0 ■ 0, a • 0 + 0 ■ b) = {a • b, 0); 

this shows that the complex numbers of the form (a, 0) behave precisely the 
same with respect to addition and multiplication of complex numbers as real 
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numbers do with their own addition and multiplication. For this reason we 
will adopt the convention that (a, 0) will be denoted simply by a. The familiar 
a + bi notation for complex numbers can now be recovered if one more 
definition is made. 



DEFINITION 



i = (0, 1). 



Notice that i 2 = (0, 1) ■ (0, 1) = (-1, 0) = -1 (the last equality sign 
depends on our convention). Moreover 

(a, b) - (a, 0) + (0, b) 

= (a, 0) + (*, 0) • (0, 1) 
= a + bi. 

You may feel that our definition was merely an elaborate device for defining 
complex numbers as "expressions of the form a + bi" That is essentially 
correct; it is a firmly established prejudice of modern mathematics that new 
objects must be defined as something specific, not as "expressions." Never- 
theless, it is interesting to note that mathematicians were sincerely worried 
about using complex numbers until the modern definition was proposed. 
Moreover, the precise definition emphasizes one important point. Our aim in 
introducing complex numbers was to avoid the necessity of paraphrasing 
statements about complex numbers in terms of their real and imaginary parts. 
This means that we wish to work with complex numbers in the same way that 
we worked with rational or real numbers. For example, the solution of the 
cubic equation required writing x = w — p/3w, so we want to know that 
1 /w makes sense. Moreover, w 2 was found by solving a quadratic equation, 
which requires numerous other algebraic manipulations. In short, we are 
likely to use, at some time or other, any manipulations performed on real 
numbers. We certainly do not want to stop each time and justify every step. 
Fortunately this is not necessary. Since all algebraic manipulations performed 
on real numbers can be justified by the properties listed in Chapter 1, it is only 
necessary to check that these properties are also true for complex numbers. 
In most cases this is quite easy, and these facts will not be listed as formal 
theorems. For example, the proof of PI, 

[(*, b) + (c, d)} + (e,f) = (a, b) + [(c, d) + (ej)] 

requires only the application of the definition of addition for complex num- 
bers. The left side becomes 

([a + c] + e, [b + d]+f) 3 

and the right side becomes 



(a + [c + elb + [d+f]); 



these two are equal because PI is true for real numbers. It is a good idea to 
check P2-P7 and P9. Notice that the complex numbers playing the role of 0 
and 1 in P2 and P6 are (0, 0) and (1, 0), respectively. It is not hard to figure 
out what — (a, b) is, but the multiplicative inverse for (a, b) required in P8 is 
a little trickier: if {a, b) ^ (0, 0), then a 2 + b 2 ^ 0 and 

This fact could have been guessed in two ways. To find (x, y) with 

(*, b)-(x,y) = (1,0) 

it is only necessary to solve the equations 

ax — by = 1, 
bx + ay — 0. 

The solutions are x = a/{a 2 + b 2 ), y = -b/(a 2 + b 2 ). It is also possible to 
reason that if \/{a + bi) means anything, then it should be true that 

1 1 a — bi __ a — bi 

a + bi a + bi a — bi a 2 + b 2 

Once the existence of inverses has actually been proved (after guessing the 
inverse by some method), it follows that this manipulation is really valid; it is 
the easiest one to remember when the inverse of a complex number is actually 
being sought — it was precisely this trick which we used to evaluate 

15 = 15 # 6 - 3i 
6 + 3* ~ 6 + 3i ' 6 - 3i 
_ 90 - 45i 
~ 36 + 9 " 

Unlike P1-P9, the rules P10-P12 do not have analogues: it is easy to prove 
that there is no set P of complex numbers such that P10-P12 are satisfied for all 
complex numbers. In fact, if there were, then P would have to contain 1 (since 
1 = l 2 ) and also -1 (since -1 = z" 2 ), and tHis would contradict P10. The 
absence of P10-P12 will not have disastrous consequences, but it does mean 
that we cannot define z < w for complex z and w. Also, you may remember 
that for the real numbers, P10-P12 were used to prove that 1 + 1^0. For- 
tunately, the corresponding fact for complex numbers can be reduced to this 
one: clearly (1, 0) + (1, 0) ^ (0, 0). 

Although we will usually write complex numbers in the form a + bi, it is 
worth remembering that the set of all complex numbers C is just the collection 
of all pairs of real numbers. Long ago this collection was identified with the 
plane, and for this reason the plane is often called the "complex plane." The 
horizontal axis, which consists of all points (a, 0) for a in R, is often called the 
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real axis, and the vertical axis is called the imaginary axis. Two important 
definitions are also related to this geometric picture. 



If z = x + iy is a complex number (with x and y real), then the conjugate z 
of z is defined as 

z = x - iy, 

and the absolute value or modulus \z\ of z is defined as 

\z\ = Vx 2 +y\ 

(Notice that x 2 + y 2 > 0, so that V # 2 + 7 2 is defined unambiguously; it 
denotes the nonnegative real square root of x 2 + y 2 .) 



Geometrically, z is simply the reflection of z in the real axis, while \z\ is the 
distance from z to (0, 0) (Figure 1). Notice that the absolute value notation for 
complex numbers is consistent with that for real numbers. The distance 
between two complex numbers z and w can be defined quite easily as \z — w\. 
The following theorem lists all the important properties of conjugates and 
absolute values. 

THEOREM 1 Let z and w be complex numbers. Then 

(1) z = z. 

(2) z = z if and only if z is real (i.e., is of the form a + 0/, for some real 
number a). 

(3) z + w = z + w. 

(4) -(z). 

(5) z - w = z • w. 

(6) F 1 = (z)~\ if z 9*0. 

(7) \z\ 2 = z-z. 

(8) \z-w\ = |*| • H- 

(9) |* + H < 1*1 + M. 

PROOF Assertions (1) and (2) are obvious. Equations (3) and (5) may be checked 
by straightforward calculations and (4) and (6) may then be proved by a trick: 

0 = 0 = z + (- *) = z_+ -z, so -z = -(*), 

1 = J = z • = 2 • z" 1 , so = (*) _1 . 

Equations (7) and (8) may also be proved by a straightforward calculation. 
The only difficult part of the theorem is (9). This inequality has, in fact, 
already occurred (Problem 4-8), but the proof will be repeated here, using 
slightly different terminology. 

It is clear that equality holds in (9) if z = 0'or w = 0. It is also easy to see 
that (9) is true if z = \w for any real number X (consider separately the cases 




z - x • 



FIGURE 1 
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X > 0 and X < 0). Suppose, on the other hand, that z ^ Xw for any real 
number X, and that w ^ 0. Then, for all real numbers^ X, 

(*) 0 < \z - Xw\ 2 = (z - Xw) • (z - Xw) 
= (z — Xw^ • (z — Xw) 
= + X 2 ww — X(wz + -zw) 
= XV| 2 + \z\ 2 - X(wz + zw). 

Notice that wz + zw is real, since 

wz + zw = wz + zw = wz + zw = wz + zw. 

Thus the right side of (*) is a quadratic equation in X with real coefficients 
and no real solutions; its discriminant must therefore be negative. Thus 

(wz + zw) 2 — 4\w\ 2 - \z\ 2 < 0; 

it follows, since wz + zw and \w\ • \z\ are real numbers, and \w\ * |z| > 0, that 

+ zw) < 2\w\ • \z\. 

From this inequality it follows that 

\z + w\ 2 = (z + w) - (z + w) 

= \z\ 2 + \w\ 2 + (wf + zw) 
< \z\ 2 + |w| 2 + 2\w\ ' \z\ 

= (kl + l^l) 2 ? 

which implies that 

\z + w\< \z\ + |w|. | 

The operations of addition and multiplication of complex numbers both 
have important geometric interpretations. The picture for addition is very 
simple (Figure 2). Two complex numbers z = (a, b) and w = (c, d) determine 
a parallelogram having for two of its sides the line segment from (0, 0) to z, 
and the line segment from (0, 0) to w; the vertex opposite (0, 0) is z + w 
(a proof of this geometric fact is left to you). 

The interpretation of multiplication is more involved. If z = 0 or w = 0, 
then z - w = 0 (a one-line computational proof can be given, but even this is 
unnecessary — the assertion has already been shown to follow from P1-P9), so 
we may restrict our attention to nonzero complex numbers. We begin by 
putting every nonzero complex number into a special form. 

For any complex number z 0 we can write 



in this expression, \z\ is a positive real number, while 

— = M = 1 

kl kl ' 



z + IV 




c a a + c 



FIGURE 2 
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of 8 radians 



so that z/\z\ is a complex number of absolute value 1 . Now any complex num- 
ber a — x + iy with 1 = \a\ = x 2 + y 2 can be written in the form 

a = (cos 0, sin 0) — cos 6 + i sin 6 

for some number 6. Thus every nonzero complex number z can be written 

z = r(cos 6 + i sin 0) 

for some r > 0 and some number 0. The number r is unique (it equals \z\), 
but 0 is not unique; if 0 O is one possibility, then the others are do + 2kw for k in 
any one of these numbers is called an argument of z. Figure 3 shows z in 
terms of r and 6. (To find an argument 8 for z — x + iy we may note that the 
equation 

x + iy = z = \z\ (cos 6 + i sin 0) 

means that 

x ~ |z|cos 0, 
y = \z\ sin 0. 

If x ?± 0 we can therefore take 6 = arctan y/x, and if x = 0, we can take 
6 = ?r/2 when y > 0 and 6 = 3?r/2 when y < 0.) 
Now the product of two nonzero complex numbers 

z == r(cos 0 + i sm 6), 
w — s(cos <t> + i sin 0), 



z - w = rs(cos 6 + i sin 6) (cos <j> + i sin 0) 

= rj[(cos 6 cos 0 — sin 6 sin 0) + z'( s m 6 cos 0 + cos 6 sin 0)] 
= ™[cos (6 + 0) + i sin (6 + 0)]. 

Thus, the absolute value of a product is the product of the absolute values of 
the factors, while the sum of any argument for each of the factors will be an 
argument for the product. For a nonzero complex number 

z = r(cos 6 + i sin 6) 

it is now an easy matter to prove by induction the following very important 
formula (sometimes known as De Moivre's Theorem): 

z n = |^| n (cos nd + i sin nd), for any argument 6 of z. 

This formula describes z n so explicitly that it is easy to decide just when 
z n = w: 

THEOREM 2 Every nonzero complex number has exactly n complex nth roots. More pre- 
cisely, fcr any complex number w ^ 0, and any natural number n, there are 
precisely n different complex numbers z satisfying z n = w. 



proof Let 



w — j-(cos 0 + 2 sin 0) 
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Vr 










\J 

- 1 



for s = \w\ and some number 0. Then a complex number 

2- — r(cos 6 + i sin 0) 
satisfies z n — w ii and only if 

r n (cos nd + 2 sin nd) = ,r(cos 0 + i sin 0), 
which happens if and only if 

cos nd + i sin rc0 = cos 0 + 2 sin 0. 
From the first equation it follows that 

r = Vs, 

where y/s denotes the positive real nth root of s. From the second equation it 
follows that for some integer k we have 

Conversely, if we choose r and 6 = Bk for some then the number 

z = r(cos 0 + i sin 0) will satisfy z n = w. To determine the number of rcth 
roots of w, it is therefore only necessary to determine which such z are distinct. 
Now any integer Jc can be written 

h = nq + k! 

for some integer q, and some integer k' between 0 and n — 1. Then 

cos 6k + i sin 0 fc = cos Ov + * sin 0^. 

This shows that every z satisfying z n = w can be written 

z = v'j (cos A*, + z sin 0*) £ = 0, . . . , w — 1 . 

Moreover, it is easy to see that these numbers are all different, since any two 
6k for k = 0, . . . , n — 1 differ by less than 2w. | 

In the course of proving Theorem 2, we have actually developed a method 
for finding the nth roots of a complex number. For example, to find the cube 
roots of i (Figure 4) note that |i| = 1 and that 7r/2 is an argument for i. The 
cube roots of i are therefore 

1 • cos — + i sin - > 
L 6 6 J 

T /ir . 2x\ .../*■ . 2tt\1 5tt . . 5tt 

1 ' L cos V6 + t) + 1 sin Vg + t)J = cos T + 1 sm T 

T , 4tt\ , . . /tt , 4ir\~| 3tt . . . 3tt 

1 ' L cos \6 7/ sin \6 17 J = cos y + ' sin T 
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7T 




. 


cos - 

6 


2 ' 


sin - 
6 


57T 




. 5tt 


cos — 




sm — 


6 


2 ' 


6 


3tt 




. 3tt 


cos — 


sin — 


2 


2 



Since 

1 

= — > 
2 

_ 1 

~ 2 ? 

= -1, 

z z 
the cube roots of i are 

VI + i - VI + i 
, , — 

2 2 

In general, we cannot expect to obtain such simple results. For exa mpl e, to 
find the cube roots of 2 + 1 li, note that |2 + 1 li\ = V2 2 + ll 2 = V 125 and 
that arctan Af is an argument for 2 + 1 h*. One of the cube roots of 2 + 1 li is 
therefore 

•\VToe T /arctan AM . . /arctan AMI 
V125 ^cos (—3— J + . sm (—3— jj 

= VI [cos (««|L*) + ,• sin (5=^)} 

Previously we noted that 2 + z is also a cube root of 2 + Hi. Since 
1 2 + i| = V2 2 + l 2 = VI, and since arctan \ is an argument of 2 + i, we 
can write this cube root as 

2 + i = Vs (cos arctan ^ + z sin arctan ^) . 

These two cube roots are actually the same number, because 

arctan V" 1 

= arctan - 

3 2 

(you can check this by using the formula in Problem 15-8), but this is hardly 
the sort of thing one might notice! 

The fact that every complex number has an nth root for all n is just a special 
case of a very important theorem. The number i was originally introduced in 
order to provide a solution for the equation x 2 + 1 =0. The Fundamental 
Theorem of Algebra states the remarkable fact that this one addition automati- 
cally provides solutions for all other polynomial equations: every equation 

z n + an-iz 71 " 1 + • • • + a 0 = 0 a 0 , . . . , a n -i in C 

has a complex root! 

In the next chapter we shall give an almost complete proof of the Funda- 
mental Theorem of Algebra; the slight gap left in the text can be filled in as an 
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exercise (Problem 25-5). The proof of the theorem will rely on several new 
concepts which come up quite naturally in a more thorough investigation of 
complex numbers. 



PROBLEMS 

1. Find the absolute value and argument of each of the following. 

(i) 3 + AL 

(ii) (3 + Ai)'\ 
(hi) (1 +Q 5 . 

(iv) a/3 + Ai. 

(v) [3 + 4z[. 

2. Solve the following equations. 

(i) x 2 + ix + 1 = 0. 

(ii) x* + x 2 + 1 = 0. 
(hi) x 2 + 2ix -1=0. 

(iv) ( ix " (1 + l)y = 3 ' 
K J \(2 + i> + *> = 4. 

(v) # 3 — x 2 — x — 2 — 0. 



3. Describe the set of all complex numbers z such that 

(i) z = -z. 

(ii) t = z-\ 

(hi) |z — a\ = |z — 6|. 

(iv) |z — a) + |* — 6| = c. 

(v) |z| < 1 — real part of z. 

4. Prove that \z\ = and that the real part of z is (z + z)/2, while the 
imaginary part is (z — z)/2i. 

5. Prove that \z + w\ 2 + \z - w| 2 = 2(|z| 2 + H 2 ), and interpret this 
statement geometrically. 

6. What is the pictorial relation between z and Vi • z V-f ?Hint: Which 
line goes into the real axis under multiplication by V — / ? 

7. (a) Prove that if a 0 , . . . , a n -i are real and a + fo" (for a and £ real) 

satisfies the equation z n + <z n _iz n_1 + • • • + a 0 = 0, then a - hi 
also satisfies this equation. (Thus the nonreal roots of such an equa- 
tion always occur in pairs, and the number of such roots is even.) 
(b) Conclude that z n + a n -iz n ~ l + • • * + a 0 is divisible by z 2 - 
2az + (a 2 + b 2 ) (whose coefficients are real). 
*8. (a) Let c be an integer which is not the square of another integer. If a 
and b are integers we define the conjugate of a + b Vc, denoted by 
a + b y/c, as a — bVc Show that the conjugate is well defined 
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by showing that a number can be written a + bVc. for integers a 
and b, in only one way. 

(b) Show that for all a and (3 of the form a + b Ve. we have a = a, 
a = a if and only if a is an integer, o: + /3 = a + /3, —ol— —a, 
a • = a - ~j3, and a -1 = (a) -1 if a 0. 

(c) Prove that if ao, . . . , a n _i are integers and z = a + £ satisfies 
the equation z n + a n _\z n ~ x + • • • + a 0 = 0, then z = a — b y/c 
also satisfies this equation. 

9. Find all the 4th roots of i; express the one having smallest argument 
in a form that does not involve any trigonometric functions. 
*10. (a) Prove that if co is an nth root of 1, then so is u k . 

(b) A number co is called a primitive nth root of 1 if { 1, a>, co 2 , . . . , 
co n_1 } is the set of all nth roots of 1. How many primitive nth roots 
of 1 are there for n = 3, 4, 5, 9? 

n-l 

(c) Let co be an nth root of 1, with co 5* 1. Prove that V co* = 0. 

k = 0 

*11. (a) Prove that if zi, . . . , lie on one side of some straight line 
through 0, then zi + • • • + ^ ^ 0. Hint: This is obvious from 
the geometric interpretation of addition, but an analytic proof is 
also easy: the assertion is clear if the line is the real axis, and a trick 
will reduce the general case to this one. 
(b) Show further that Zi -1 , . . . , z k ~~ l all lie on one side of a straight 
line through 0, so that zC l + • • • + z k ~ l 9* 0. 
*12. Prove that if \zi\ — \z 2 \ = \z 3 \ and z 1 + z 2 + z z = 0, then z h z 2 , and z z 
are the vertices of an equilateral triangle. Hint: It will help to assume 
that zi is real, and this can be done with no loss of generality. Why? 
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CHAPTER W COMPLEX FUNCTIONS 



You will probably not be surprised to learn that a deeper investigation of 
complex numbers depends on the notion of functions. Until now a function 
was (intuitively) a rule which assigned real numbers to certain other real 
numbers. But there is no reason why this concept should not be extended; we 
might just as well consider a rule which assigns complex numbers to certain 
other complex numbers. A rigorous definition presents no problems (we will 
not even accord it the full honors of a formal definition) : a function is a collec- 
tion of pairs of complex numbers which does not contain two distinct pairs 
with the same first element. Since we consider real numbers to be certain com- 
plex numbers, the old definition is really a special case of the new one. Never- 
theless, we will sometimes resort to special terminology in order to clarify 
the context in which a function is being considered. A function / is called 
real-valued iff(z) is a real number for all z in the domain of /, and complex- 
valued to emphasize that it is not necessarily real-valued. Similarly, we will 
usually state explicitly that a function / is defined on [a subset of] R in those 
cases where the domain of / is [a subset of] R; in other cases we sometimes 
mention that / is defined on [a subset of] C to emphasize that f{z) is defined 
for complex z as well as real z. 

Among the multitude of functions defined on C, certain ones are particu- 
larly important. Foremost among these are the functions of the form 

/(*) = a n z n + an^z"- 1 + • • ■ + a 0 , 

where a 0) . . . , a n are complex numbers. These functions are called, as in 
the real case, polynomial functions; they include the function f(z) — z (the 
"identity function") and functions of the form f(z) = a for some complex 
number a ("constant functions"). Another important generalization of a 
familiar function is the "absolute value function" f(z) = \z\ for all z in C. 

Two functions of particular importance for complex numbers are Re (the 
"real part function") and Im (the "imaginary part function"), defined by 

Re(# + iy) — x, ^ ^ rea j 
Im(* + iy) = y, 

The "conjugate function" is defined by 

f(z) = z = ReW - am (z). 

Familiar real-valued functions defined on R may be combined in many 
ways to produce new complex-valued functions defined on C — an example 
is the function 

,f(x + iy) = e v sin (x — y) + ix z cos y. 

448 
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The formula for this particular function illustrates a decomposition which is 
always possible. Any complex-valued function / can be written in the form 

/ = u + iv 

for some real-valued functions u and v — simply define u(z) as the real part of 
f(z), and v(z) as the imaginary part. This decomposition is often very useful, 
but not always; for example, it would be inconvenient to describe a poly- 
nomial function in this way. 

One other function will play an important role in this chapter. Recall that 
an argument of a nonzero complex number z is a (real) number 6 such that 

z = |*| (cos 0 + i sin 6). 

There are infinitely many arguments for z, but just one which satisfies 
0 < 6 < 2tt. If we call this unique argument d(z), then 6 is a (real-valued) 
function (the "argument function") on {z in C: z ^ 0} . 

" Graphs" of complex- valued functions defined on C, since they lie in 
4-dimensional space, are presumably not very useful for visualization. The 
alternative picture of a function mentioned in Chapter 4 can be used instead: 
we draw two copies of C, and arrows from z in one copy, to f(z) in the other 
(Figure 1). 




'•/(*) 

FIGURE 1 



The most common pictorial representation of a complex-valued function is 
produced by labeling a point in the plane with the value /(z), instead of with z 
(which can be estimated from the position of the point in the picture). Figure 
2 shows this sort of picture for several different functions. Certain features of 
the function are illustrated very clearly by such a "graph." For example, the 
absolute value function is constant on concentric circles around 0, the func- 
tions Re and Im are constant on the vertical and horizontal lines, respectively, 
and the function /(z) = z 2 wraps the circle of radius r twice around the circle 
of radius r 2 . 

Despite the problems involved in visualizing complex-valued functions in 
general, it is still possible to define analogues of important properties pre- 
viously defined for real-valued functions on R, and in some cases these 
properties may be easier to visualize in the complex case. For example, the 
notion of limit can be defined as follows: 

lim f(z) = / means that for every (real) number £ > 0 there is a (real) 
rmmber d > 0 such that, for all z, if 0 < \z - a\ < d, then \f(z) - /| < S. 




FIGURE 2 
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Although the definition reads precisely as before, the interpretation is slightly 
different. Since \z — w\ is the distance between the complex numbers z and w 9 
the equation lim f(z) = / means that the values of f(z) can be made to lie 

z— >a 

inside any given circle around /, provided that z is restricted to lie inside a 
sufficiently small circle around a. This assertion is particularly easy to visualize 
using trie "two copy" picture of a function (Figure 3). 



FIGURE 3 



Certain facts about limits can be proved exactly as in the real case. In 
particular, 

lim c = c, 

Z—Kl 

lim z = a, 
lim [f(z) + g(z)] = lim /(*) + lim g(z), 

z—>a 2—* a z—*a 

lim f(z) ' g(z) = lim f(z) • lim g{z) y 
lim -\- = - 1 - > if lim g(z) ^ 0. 

z~+a g(z) lim g(Z) z-+a 

The essential property of absolute values upon which these results are based 
is the inequality \z + w\ < \z\ + \w\, and this inequality holds for complex 
numbers as well as for real numbers. These facts already provide quite a few 
limits, but many more can be obtained from the following theorem. 

THEOREM l Let/(» = u(z) + iv{z) for real- valued functions u and v, and let / = a + iff 
for real numbers a and 0. Then lim f{z) = I if and only if 

z—>a 

lim u{z) = a, 

z-+a 

lim v(z) = 0. 

2— >0 

proof Suppose first that lim f(z) = /. If e > 0, there is 6 > 0 such that, for all 

if 0 < |* - fl| < «, then |/(*) - l\ < e. 
The second inequality can be written 

|[«(z) -a] + i[v(z) -jS]| < e, 
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or 

[«(*) - a} 2 + [v(z) - 0] 2 < e 2 . 

Since u{z) — a and v(z) — ft are both real numbers, their squares are positive; 
this inequality therefore implies that 

[u(z) - a] 2 < £ 2 and [v{z) - p] 2 < £ 2 , 

which implies that 

\u(z) - a\ < £ and \v{z) - 0\ < £. 
Since this is true for all £ > 0, it follows that 

lim u(z) = a and lim v(z) = /3. 

z— * a z— > a 

Now suppose that these two equations hold. If £ > 0, there is a 5 > 0 such 
that, for all z, if 0 < \z - a\ < <5, then 



£ £ 

|w(z) — a\ < - and |z/(z) — a\ < -> 



which implies that 



|/(z) - /| = - a] + i[v{z) - 0]\ 

< \u(z) -a\ + \i\ • \v(z) - jS| 
£ , £ 

2 2 

This proves that lim f(z) = I. | 

In order to apply Theorem 1 fruitfully, notice that since we already know 
the limit lim z = a, we can conclude that 

z— >a 

lim Re(z) = Re(a), 

2— *a 

lim Im(z) = Im(fl). 

z— >a 

A limit like 

lim sin (Re (z)) = sin (Re (a)) 

z— »a 

follows easily, using continuity of sin. Many applications of these principles 
prove such limits as the following: 

lim z — a } 

z—>a 

lim |,?| = \a\, 

z->a 

lim e y sin x + ix 3 cos ^ = e b sin a + ia 3 cos 

(x-fi3/)-*a + fci 

Now that the notion of limit has been extended to complex functions, the 
notion of continuity can also be extended: / is continuous at a if lim f(z) — 
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f(a), and /is continuous if /is continuous at a for all a in the domain of/. The 
previous work on limits shows that all the following functions are continuous: 

f(z) = a n z n + a n ^z n ~ l + • • • + fl 0 , 
/(') = 

/(*) = 14 
/(* + zy) = ^ sin x + z'* 3 cos jy. 

Examples of discontinuous functions are easy to produce, and certain ones 
come up very naturally. One particularly frustrating example is the "argu- 
ment function" 0, which is discontinuous at all nonnegative real numbers 
(see the "graph" in Figure 2). By suitably redefining 6 it is possible to change 
the discontinuities; for example (Figure 4), if 8 f (z) denotes the unique argu- 
ment of z with 7r/2 < 0'{z) < 57r/2, then 6' is discontinuous at ai for every 
nonnegative real number a. But, no matter how 6 is redefined, some discon- 
tinuities will always occur. 
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FIGURE 4 


= 0'{z) 



The discontinuity of 0 has important bearing on the problem of defining a 
"square-root function," that is, a function /such that (/(*)) 2 = zforall^r. For 
real numbers the function y/ had as domain only the nonnegative real num- 
bers. If complex numbers are allowed, then every number has two square roots 
(except 0, which has only one). Although this situation may seem better, it is 
in some ways worse; since the square roots of z are complex numbers, there is 
no clear criterion for selecting one root to be f(z)> in preference to the other. 



One way to define / is the following. We set /(0) = 0, and for z 9^ 0 we set 
/W =VH(cos^+*sinM). 

Clearly (f(z)) 2 = z, but the function / is discontinuous, since 6 is discontinu- 
ous. As a matter of fact, it is impossible to find a continuous / such that 
(/(*)) 2 = z for all z. Although you may be willing to accept this assertion 
without any fuss, the argument, given below, is rather tricky. 

We will actually show that a continuous square root function / cannot even 
be defined on the set of all z with \z\ = 1. Suppose there were such a func- 
tion /. We must have /(l) = 1 or /(l) = — 1, and we can therefore assume 
that /(I) = —1, since —/would also be a continuous square root function. 
In this case, since / does not have the value 1 at 1 , it never takes on the value 1 . 
This means that if we define g by 

g{z) = 8(f(z)) for |*| = 1, 

then g will be continuous, since 6 is continuous at all w with \w\ — 1 except for 
w = 1, which is not f(z) for any z. But the equation 

(f(z)Y = z 

implies that 

8(z) = 20(f(z)) = 2g(z), 

which would imply that 0 is continuous at z for all z with \z\ = 1 . Since this is 
false, no such function /can exist. Similar arguments show that it is impossible 
to define continuous "r/th-root functions" for any n > 2. 

For continuous complex functions there are important analogues of certain 
theorems which describe the behavior of real-valued functions on closed inter- 
vals. A natural analogue of the interval [a, b] is the set of all complex numbers 
z = x + iy with a < x < b and c < y < d (Figure 5). This set is called a 
closed rectangle, and is denoted by [a, b] X [c, d]. 

If /is a continuous complex-valued function whose domain is [a, b] X [c, d], 
then it seems reasonable, and is indeed true, that / is bounded on [a, b] X [c, d]. 
That is, there is some real number M such that 

|/(<r) | < M for all z in [a, b] X [c, d]. 

It does not make sense to say that / has a maximum and a minimum value on 
[a, b] X [c, d], since there is no notion of order for complex numbers. If / is a 
real-valued function, however, then this assertion does make sense, and is true. 
In particular, if /is any complex-valued continuous function on [a, b] X [c, d\ 
then | /| is also continuous, so there is some z 0 in [a, b] X [c, d] such that 

\f(zo)\ < \f(z)\ for all z in [a, b] X [c, d]; 

a similar statement is true with the inequality reversed. It is sometimes said 
that "/ attains its maximum and minimum modulus on [a, b] X [c, d]." 
The various facts listed in the previous paragraph will not be proved here, 
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although proofs are outlined in Problem 5. Assuming these facts, however, we 
can now give a proof of the Fundamental Theorem of Algebra, which is 
really quite surprising, since we have not yet said much to distinguish poly- 
nomial functions from other continuous functions. 



THEOREM 2 (THE fundamental Let a 0 , . . . , <z n _i be any complex numbers. Then there is a complex number 
THEOREM OF ALGEBRA) , such that 



+ a 0 = 0. 



PROOF Let 

f(z) = z n + a n ^z n ~ l + • ■ • + a 0 . 
Then / is continuous, and so is the function |/| defined by 

l/l to = l/to I = I*" + tfn-i^" 1 + * • ' + a 0 \. 

Our proof is based on the observation that a point z 0 with f(z 0 ) = 0 would 
clearly be a minimum point for |/|. To prove the theorem we will first show 
that | /| does indeed have a smallest value on the whole complex plane. The proof 
will be almost identical to the proof, in Chapter 7, that a polynomial function 
of even degree (with real coefficients) has a smallest value on all of R; both 
proofs depend on the fact that if \z\ is large, then \f(z)\ is large. 
We begin by writing, for z ^ 0, 



so that 



Let 



+ 



■?)' 



+ 



<20 



M = max(l, 2w|<2 n _i|, . . . , 2rc|<2 0 |). 
Then for all z with \z\ > M, we have \z k \ > \z\ and 



SO 



<2n-l 



+ 



< 



2«|a n _A;| 



which implies that 



+ 



> 1 - 



+ 



' + 



<1, 
~ 2 



+ 



z n 



> 



This means that 



|/to I > for |*| > Af. 
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In particular, if \z\ > M and also \z\ > V2\f(0)\, then 

I/Ml > l/WI- 

Now let [a, b] X [c, d] be a closed rectangle (Figure 6) which contains 
{z: \z\ < max(M, V2\f(0)\)}, and suppose that the minimum of |/| on 
[a, b] X [c, d] is attained at z 0 , so that 

(1) |/(* 0 )| < for * in X [c, d]. 

It follows, in particular, that |/(^ 0 )| < |/(0)|. Thus 

(2) if |*| > max(Af, ^2|/(0)|), then \f(z)\ > |/(0)| > \f(z 0 )\. 

Combining (1) and (2) we see that |/(z 0 )| < |/W| for all z, so that |/| attains 
its minimum value on the whole complex plane at z 0 . 




FIGURE 6 



To complete the proof of the theorem we now show that f(z Q ) = 0. It is 
convenient to introduce the function g defined by 

g(z) = fit + ^o). 

Then g is a polynomial function of degree n, whose minimum absolute value 
occurs at 0. We want to show that g(0) = 0. 

Suppose instead that g(0) = a ^ 0. If m is the smallest positive power of* 
which occurs in the expression for g, we can write 

g{z) = <x + /3z m + c m+l z m+l + • • • + c n z n , 

where 0 9* 0. Now, according to Theorem 24-2 there is a complex number 7 
such that 




Complex Functions 457 



Then, setting d k = Cky k , we have 



\g(yz)\ = \a + (3y m z m + d m+1 z m+1 + • • • + d n z»\ 
= \a - az m + d m+1 z m+1 + • • -| 

= | a (l - z m + ^S±! +---)| 
= | a (l - + z m *+'■•])! 



= \a\- 1 ~z m + z m \ d ^-z + 
I L a 



I 



This expression, so torturously arrived at, will enable us to reach a quick 
contradiction. Notice first that if \z\ is chosen small enough, we will have 



— -2- z + 
a 



< 1. 



If we choose, from among all z for which this inequality holds, some z which 
is real and positive^ then 

I zm \~ *+•■•]!< = zm - 

Consequently, if 0 < z < 1 we have 

1 -z m + z m [~*+ * ' ']|<|1 + + • • -]| 

= 1 - z m + \z n 



< 1 - z m + z n 

= 1. 



This is the desired contradiction : for such a number z we have 

\g(yz)\ < \a\, 

contradicting the fact that I ol\ is the minimum of \g\ on the whole plane. 
Hence, the original assumption must be incorrect, andg(O) = 0. This implies, 
finally, that f(z 0 ) = 0. | 

Even taking into account our omission of the proofs for the basic facts about 
continuous complex functions, this proof verified a deep fact with surprisingly 
little work. It is only natural to hope that other interesting developments will 
arise if we pursue further the analogues of properties of real functions. The 
next obvious step is to define derivatives: a function /is differentiable at a if 

r f(a + z) -f(a) . 

hm J - ^ exists, 

*->o z 
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in which case the limit is denoted by f'(a). It is easy to prove that 

f(a) = 0 if /(*) = c, 
f(a) = 1 if /(^) = z, 

(f + gY(fl) =/'(«) 
(/•*)'(«) =/W«) + /(«)*'(«), 



(/«•«)'(«) =f(g(a))-g'{a); 

the proofs of all these formulas are exactly the same as before. It follows, in 
particular, that if f(z) = z n , then f'(z) - nz n ~\ These formulas only prove 
the differentiability of rational functions however. Many other obvious 
candidates are not differentiate. Suppose, for example, that 

/(* + iy) = x - iy (i.e., f(z) = z). 

If / is to be differentiable at 0, then the limit 

lim ** + »> -AO), ita 

(x+t W )->o * + iy (x+iy)->o x + iy 

must exist. Notice however, that 



and 



ify = 0, then^ = 1, 

x + iy 



if x = 0, then = - 1 ; 



therefore this limit cannot possibly exist, since the quotient has both the values 
1 and — 1 for x + iy arbitrarily close to 0. 

In view of this example, it is not at all clear where other differentiable func- 
tions are to come from. If you recall the definitions of sin and exp, you will see 
that there is no hope at all of generalizing these definitions to complex num- 
bers. At the moment the outlook is bleak, but all our problems will soon be 
solved. 



PROBLEMS 

1. (a) For any real number y, define a (x) = x + iy (so that a is a complex- 

valued function defined on R). Show that a is continuous. (This 
follows immediately from a theorem in this chapter.) Show similarly 
that P(y) = x + iy is continuous, 
(b) Let / be a continuous function denned on C. For fixed y, let g(x) = 
f(x + iy) . Show that g is a continuous function (defined on R) . Show 
similarly that h{y) = f(x + iy) is continuous. Hint: Use part (a). 

2. (a) Suppose that / is a continuous real-valued function defined on a 

closed rectangle [a, b] X [c, d]. Prove that if/ takes on the values f(z) 
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and f(w) for z and w in [a, b] X [c, d], then / also takes all values 
between f{z) and f(w). Hint: Consider g(t) = /(£? + (1 - 0«0 for * 
in [0, 1]. 

*(b) If / is a continuous complex-valued function defined on [a, b] X 
[c, d], the assertion in part (a) no longer makes any sense, since we 
cannot talk of complex numbers between f(z) and f(w). We might 
conjecture that / takes on all values on the line segment between /0) 
and f(w), but even this is false. Find an example which shows this. 

(a) Prove that if a 0 , . . . , a n _ x are any complex numbers, then there are 
complex numbers z u . . . , z n (not necessarily distinct) such that 

n 

z n + a n ^z n - 1 + • • • + a 0 = [I 0 " *<)• 

t = i 

(b) Prove that if a 0) . . . , a n -i are real, then z n + a n _iz n ~ x + ' ' ' + a 0 
can be written as a product of linear factors z + a and quadratic 
factors z 2 + az + £ all of whose coefficients are real. (Use Problem 
24-7.) 

In this problem we will consider only polynomials with real coefficients. 
Such a polynomial is called a sum of squares if it can be written as 
^2 _|_ . . . _|_ ^ n 2 f or polynomials h with real coefficients. 

(a) Prove that if / is a sum of squares, then f(x) > 0 for all x, 

(b) Prove that if / and g are sums of squares, then so is / • g. 

(c) Suppose that/(*) > 0 for all x. Show that / is a sum of squares. Hint: 
First write f(x) = x k g(x), where g(x) 7* 0 for all x. Then £ must be 
even (why?), and g(x) > 0 for all x. Now use Problem 3(b). 

(a) Let A be a set of complex numbers. A number z is called, as in the real 
case, a limit point of the set A if for every (real) £ > 0, there is a 
point a in A with \z — a\ < £ but z ^ a. Prove the two-dimensional 
version of the Bolzano- Weierstrass Theorem: If ^4 is an infinite subset 
of [a, 6] X [c, d], then ^4 has a limit point in [a, b] X |>, Hint: 
First divide [a, b] X [c, d] ijh half by a vertical line as in Figure 7(a). 
Since A is infinite, at least one half contains infinitely many points of 
A. Divide this in half by a horizontal line, as in Figure 7(b). Continue 
in this way, alternately dividing by vertical and horizontal lines. 
(The two-dimensional bisection argument outlined in this hint is so 
standard that the title 1 c Bolzano- Weierstrass" often serves to describe 
the method of proof, in addition to the theorem itself. See, for example, 
H. Petard, "A Contribution to the Mathematical Theory of Big Game 
Hunting," Arner. Math. Monthly, 45 (1938), 446-447.) 

(b) Prove that a continuous (complex-valued) function on [a, b] X [c, d] 
is bounded on [a, b] X [c, d]. (Imitate Problem 21-22.) 

(c) Prove that if/ is a real-valued continuous function on [a, b] X [c, d\ 
then / takes on a maximum and minimum value on [a, b] X [c, d]. 
(You can use the same trick that works for Theorem 7-3.) 
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(a) a convex subset of the plane 




(b) a nonconvex subset of the plane 
FIGURE 8 



*6. The proof of Theorem 2 cannot be considered to be completely ele- 
mentary because the possibility of choosing y with y m = —a//3 depends 
on Theorem 24-2, and thus on the trigonometric functions. It is therefore 
of some interest to provide an elementary proof that there is a solution for 
the equation z n — c = 0. 

(a) Make an explicit computation to show that solutions of z 2 — c = 0 
can be found for any complex number c. 

(b) Explain why the solution of z n — c — 0 can be reduced to the case 
where n is odd. 

(c) Let z 0 be the point where the function f(z) = z n — c has its minimum 
absolute value. If z 0 ^ 0, show that the integer m in the proof of 
Theorem 2 is equal to 1; since we can certainly find y with 7 1 — 
— a/ /3, the remainder of the proof works for /. It therefore suffices to 
show that the minimum absolute value of /does not occur at 0. 

(d) Suppose instead that /has its minimum absolute value at 0. Since n is 
odd, the points ±5, ± 8i go under /into —c ± 5 n , —c± 8 n i. Show 
that for small 6 at least one of these points has smaller absolute value 
than — c, thereby obtaining a contradiction. 

7. Let f(z) = 0 - z0 Wl •••(*- **)"*. 

k 

(a) Show that f{z) = (z - zi) mi •■•(*- z k ) m " ■ £ m a (z - z a )~\ 

k 

(b) Let^O) = ^ m a (z - z a )~ x . Show that if g(z) = 0, then^i, . . . , z k 

a= 1 

cannot all lie on the same side of a straight line through z. Hint: Use 
Problem 24-11. 

(c) A subset K of the plane is convex if K contains the line segment join- 
ing any two points in it (Figure 8). For any set A, there is a smallest 
convex set containing it, which is called the convex hull of A (Figure 
9) ; if a point P is not in the convex hull of A, then all of A is contained 




FIGURE 9 
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on one side of some straight line through P. Using this information, 
prove that the roots of f (z) = 0 lie within the convex hull of the set 
{zi, . . . , zjt}. (The definition of convexity in the Appendix to 
Chapter 1 1 is related to the one given here — a function / is convex 
if the set of points lying above or on the graph of / is a convex set, and 
if the graph contains no straight line segments. Further details about 
convex sets will be found in reference [19] of the Suggested Reading.) 

8. Prove that if / is differentiate at z, then / is continuous at z. 
*9. Suppose that / — u + iv where u and v are real- valued functions. 

(a) For fixed y 0 \ctg(x) = u(x + iyo) and h(x) = v(x + iy 0 ). Show that if 
f(x 0 + iyo) = a + if$ for real a and ft then g' fa) — a and h! (x 0 ) = ft 

(b) On the other hand, suppose that k(y) = u(x 0 + iy) and l{y) = 
v(x Q + iy). Show that l'(y 0 ) = a and k'(y 0 ) = -ft 

(c) Suppose that/(z) = 0 for all z. Show that / is a constant function. 

10. (a) Using the expression 




find f k) (x) for all L 
(b) Use this result to find arctan a) (0) for all k. 



CHAPTER 




COMPLEX POWER SERIES 











ai # 




• 

• 


as 
• # 

% •<2io 




• •«„ 

a 13 an 



FIGURE 1 




FIGURE 2 



If you have not already guessed where differentiable complex functions are 
going to come from, the title of this chapter should give the secret away: we 
intend to define functions by means of infinite series. This will necessitate a 
discussion of infinite sequences of complex numbers, and sums of such 
sequences, but (as was the case with limits and continuity) the basic definitions 
are almost exactly the same as for real sequences and series. 

An infinite sequence of complex numbers is, formally, a complex-valued 
function whose domain is N; the convenient subscript notation for sequences 
of real numbers will also be used for sequences of complex numbers. A 
sequence {a n } of complex numbers is most conveniently pictured by labeling 
the points a n in the plane (Figure 1). 

The sequence shown in Figure 1 converges to 0, "convergence' 5 of complex 
sequences being defined precisely as for real sequences: the sequence \a n ) 
converges to /, in symbols 

lim a n — /, 

n—» oo 

if for every e > 0 there is a natural number N such that, for all n, 

if n > N, then \a n — l\ < S. 

This condition means that any circle drawn around / will contain a n for all 
sufficiently large n (Figure 2); expressed more colloquially, the sequence is 
eventually inside any circle drawn around /. 

Convergence of complex sequences is not only defined precisely for real 
sequences, but can even be reduced to this familiar case. 



THEOREM 1 Let 

and let 



a n = b n + ic n for real b n and c n , 

I = 0 + iy for real 0 and y. 
Then lim a n = I if and only if 

lim b n — 0 and lim c n = y. 



PROOF The proof is left as an easy exercise. If there is any doubt as to how to proceed, 
consult the similar Theorem 1 of Chapter 25. | 

The sum of a sequence \a n \ is defined, once again, as lim s n , where 

n— > oo 

s n = a\ + ' ' ' + a n . 
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Sequences for which this limit exists are summable; alternatively, we may 
say that the infinite series ^ a n converges if this limit exists, and diverges 

n = 1 

otherwise. It is unnecessary to develop any new tests for convergence of 
infinite series, because of the following theorem. 

THEOREM 2 Let 

an — b n + ic n for real b n and c n . 



Then £ a n converges if and only if £ b * and £ c n both converge, and in 

n = 1 n = 1 

00 00 00 

2 a n = £ + c n ). 



n = l 

this case 



n — l n = 1 



PROOF This is an immediate consequence of Theorem 1 applied to the sequence of 
partial sums of {a n }. | 

There is also a notion of absolute convergence for complex series: the series 

00 °o 

^ a n converges absolutely if the series ^ \a n \ converges (this is a series of 

n = 1 n — l 

real numbers, and consequently one to which our earlier tests may be applied). 
The following theorem is not quite so easy as the preceding two. 

THEOREM 3 Let 

a n = bn + ic n for real b n and c n . 

00 00 » 

Then ^ a n converges absolutely if and only if ^ b n and ^ c n both COU- 
rt = l n = 1 n = l 

verge absolutely. 

00 00 

PROOF Suppose first that £ 6 n and ^ c n both converge absolutely, i.e., that 

n = 1 n = 1 

00 00 00 

2 I I and £ |c n | both converge. It follows that £ |£ n | + \c n \ converges. 

n = 1 n = 1 n - 1 

Now, 

k| = \b n + lCn\ < \bn\ + M» 

It follows from the comparison test that ^ \a n \ converges (the numbers \a n \ 

n = 1 

00 

and \b n \ + \c n \ are real and nonnegative) . Thus £ a n converges absolutely. 
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Now suppose that ^ \a n \ converges. Since 



it is clear that 

\b n \ < \a n \ and \c n \ < \a n \. 

00 00 

Once again, the comparison test shows that ^ \b n \ and ^ \c n \ converge. | 

n = 1 n = 1 

00 

Two consequences of Theorem 3 are particularly noteworthy. If ^ a n 

n = 1 

00 00 

converges absolutely, then ^ b n and ^ c n also converge absolutely; COnSe- 
T^l 71 = 1 
00 00 00 

quently ^ b n and ^ converge, by Theorem 22-4, so ^ a n converges by 

n=l n=l n—1 

Theorem 2. In other words, absolute convergence implies convergence. 
Similar reasoning shows that any rearrangement of an absolutely convergent 
series has the same sum. These facts can also be proved directly, without 
using the corresponding theorems for real numbers, by first establishing an 
analogue of the Cauchy criterion (see Problem 12). 

With these preliminaries safely disposed of, we can now consider complex 
power series, that is, functions of the form 

/0) = ^ a n (z - a) n = a 0 + ai(z — a) + a 2 {z — a) 2 + ' ' ' 

n = 0 

Here the numbers a and a n are allowed to be complex, and we are naturally 
interested in the behavior of / for complex z. As in the real case, we shall 
usually consider power series centered at 0, 



/w = I 



a n z" 

n = 0 



in this case, if f(z 0 ) converges, then /(z) will also converge for \z\ < \z 0 \. The 
proof of this fact will be similar to the proof of Theorem 23-6, but, for reasons 
that will soon become clear, we will not use all the paraphernalia of uniform 
convergence and the Weierstrass Af-test, even though they have complex 
analogues. Our next theorem consequently generalizes only a small part of 
Theorem 23-6. 

THEOREM 4 Suppose that 

) a n z 0 n = a 0 + aiz 0 + a^z 0 2 + • • • 

nt'o 

converges for some z Q ^ 0. Then if \z\ < \z 0 \, the two series 
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PROOF 



^ a n z n = a 0 + aiz + a 2 z 2 + • ■ • 

71 = 0 
00 

both converge absolutely. 

As in the proof of Theorem 23-6, we will need only the fact that the set of 
numbers a n z 0 n is bounded: there is a number M such that 



We then have 



\a n z 0 n \ < M for all n 
\a n z n \ = \a n z 0 n \ 



< M 



and, for z ^ 0, 



\na n z 



Ti n\a n z 0 l 
\z\ 



M 

- T~\ n 
\z\ 



Since the series ^ \z/z Q \ n and £ n\z/z 0 \ n converge, this shows that both 

71 = 0 71 = 1 

oo CO 00 

^ <z n £ n and Y M n ^ n-1 converge absolutely (the argument for ^ na n z n ~ x 

71 = 0 71 = 1 n = 1 

assumed that z ^ 0, but this series certainly converges for z = 0 also). | 
Theorem 4 evidently restricts greatly the possibilities for the set 
{z: ^ a n z n converges}. 

71 = 0 

For example, the shaded set A in Figure 3 cannot be the set of all z where 

00 

^ a n z n converges, since it contains z y but not the number w satisfying 

n \w\ < \z\. 

It seems quite unlikely that the set of points where a power series converges 
could be anything except the set of points inside a circle. If we allow "circles 
of radius 0" (when the power series converges only at 0) and "circles of 
radius oo" (when the power series converges at all points), then this assertion 
is true (with one complication which we will soon mention) ; the proof requires 
only Theorem 4 and a knack for good organization. 
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THEOREM 5 For any power series 

00 

) a n z n = a 0 + aiz + a 2 z n + a z z 2 + • • • 
one of the following three possibilities must be true: 

00 

(1) ^ a n z n converges only for z = 0. 

n = 0 

00 

(2) ^ a n ^ n converges absolutely for ail z in C. 

n = 0 

(3) There is a number R > 0 such that ^ a^ 71 converges absolutely if 

n = 0 

|*| < and diverges if \z\ > R. (Notice that we do not mention w r hat 
happens when \z\ — R.) 

proof Let 

00 

S — {x in R: V <2 n w n converges for some a; with = #}. 

n = 0 

Suppose first that £ is unbounded. Then for any complex number z, there 

00 

is a number x in S such that |z| < x. By definition of £, this means that ^ tf n w n 

71 = 0 

converges for some w with \w\ = x > \z\. It follows from Theorem 4 that 

00 

^ <z n z n converges absolutely. Thus, in this case possibility (2) is true. 

71=0 

Now suppose that S is bounded, and let R be the least upper bound of S. If 
R = 0, then ^ tf n £ n converges only for z = 0, so possibility (1) is true. Sup- 

71=0 

pose, on the other hand, that R > 0. Then if z is a complex number with 
|z| < R, there is a number x in £ with \z\ < x. Once again, this means that 

00 00 

^ a n w n converges for some w with \z\ < \w\, so that ^ 0 n z n converges 

n = 0 71 = 0 

00 

absolutely. Moreover, if \z\ > /?, then ^ # n z n does not converge, since |z| is 

n = 0 

not in S. | 

The number R which occurs in case (3) is called the radius of convergence 

so 

of ^ a n z n . In cases (1) and (2) it is customary to say that the radius of con- 

n = 0 

vergence is 0 and <x> ? respectively. When 0 < R < <x>, the circle \z\ \z\ = R\ 
is called the circle of convergence of ^ a n z n . If z is outside the circle, then, 
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bounded 



circle of convergence 



of course, ^ a n z n does not converge, but actually a much stronger statement 

n = 0 

can be made: the terms a n z n are not even bounded. To prove this, let w be 
any number with \z\ > \w\ > R; if the terms a n z n were bounded, then the 

proof of Theorem 4 would show that ^ a n w n converges, which is false. Thus 

71=0 

00 

(Figure 4), inside the circle of convergence the series ^ a n z n converges in the 

n = 0 

best possible way (absolutely) and outside the circle the series diverges in the 
worst possible way (the terms a n z n are not bounded). 

What happens on the circle of convergence is a much more difficult question. 
We will not consider that question at all, except to mention that there are 
power series which converge everywhere on the circle of convergence, power 
series which converge nowhere on the circle of convergence, and power series 
that do just about anything in between. (See Problem 5.) 

Remember that our goal in this chapter is to produce differentiable func- 
tions. We therefore want to generalize the result proved for real power series 
in Chapter 23, that a function defined by a power series can be differentiated 
term-by-term inside the circle of convergence. At this point we can no longer 
imitate the proof of Chapter 23, even if we were willing to introduce uniform 
convergence, because no analogue of Theorem 23-3 seems available. Instead 
we will use a direct argument (which could also have been used in Chapter 23). 
Before beginning the proof, we notice that at least there is no problem about 
the convergence of the series produced by term- by- term differentiation. If the 

oo 

series ^ a n z n has radius of convergence R, then Theorem 4 immediately 

n = 0 

implies that the series ^ na n z n ~ l also converges for \z\ < R. Moreover, if 

n=l 

\z\ > R, so that the terms a n z n are unbounded, then the terms na n z n ~ l are 

OS 

surely unbounded, so ^ na n z n ~ l does not converge. This shows that the 

n — 1 

00 

radius of convergence of ^ na n z n ~~ x is also exactly R. 



theorem 6 If the power series 



f(z) = J a n z n 



has radius of convergence R > 0, then / is differentiable at z for all z with 
\z\ < R, and 



na n z n 
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PROOF We will use another "s/3 argument. 55 The fact that the theorem is clearly 
for polynomial functions suggests writing 



true 



(*) 



/(* + A) -/(*) 



00 

\l; 

n = 0 



00 00 

- ^ na n z n ~ l j = | 

n=l n=0 
AT 



((* + £) n - 



— ) na n z n 

k 



((z + h) n — z n ) 



+ A)" - z") 



+ 



((£ + A)" - z») 



— y na n z 

k 



N » 

n = 1 n=»l 



We will show that for any £ > 0, each absolute value on the right side can be 
made < e/3 by choosing N sufficiently large and h sufficiently small. This will 
clearly prove the theorem. 

Only the first term in the right side of (*) will present any difficulties. To 
begin with, choose some z 0 with \z\ < \z 0 \ < R; henceforth we will consider 
only h with \z + h\ < \z 0 \. The expression {{z + h) n - z n )/h can be written 
in a more convenient way if we remember that 

*1 \.ZJ1 = x n-l + x n-2 y + x n-y _|_ . . . + y«~\ 
— v 



x — y 
Applying this to 



0 + h) n - z n _ (z + h) n - z n 

. ; , 

h 



we obtain 

(z + h) n - z n 



(z + h) -z' 
= (z + hy~ l + z(z + h) n ~ 2 + • • ' + z n ~ l . 



Since 



we have 



\(z + h) n ' 1 + z{z + h) n ~ 2 + • • • + z n ~ l \ < n\zo\ n -\ 



j(z + h) n - g) 



< n\a n \ • |z 0 | n_1 . 

00 

But the series ^ n\a n \ ' ko| n_1 converges, so if N is sufficiently large, then 

n= 1 

^ n\a n \ 



n = N + l 
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This means that 

I V On ((* + hY - z") V Kg + A )" ~ *"> 

\l 1 l an ^— h 

n = 0 n=0 

I v ccg + *)" - ■g") i ^ v i 
. 2, «• 1 — - -2/ r 

n = AT-fl n = JV + 1 

00 

< V «kl • kd— 1 < f- 

In short, if N is sufficiently large, then 



((z + A)» - 
h 



(1) 



V ((* + h) n - z n ) v ((* + hY - z n ) 
l an IT l an h 

n=0 n=0 



S 

<3 



for all h with |* + h\ < \z<\. 



CO 

It is easy to deal with the third term on the right side of (*) : Since ^ na n z n ~ x 

71 = 1 

converges, it follows that if N is sufficiently large, then 



(2) y^na n z«-i 

n = 1 



IV 

- ^ na n z n 



<3 



Finally, choosing an N such that (1) and (2) are true, we note that 

((Z + h) n ~ Z n ) £ 

hm ) a n = > J 

n=0 n=l 



na n z n 



since the 
Therefore 



AT 

polynomial function gO) = ^ <z n 2: n is certainly differentiable. 

71 = 0 



AT 

< 3 >I2 : 

71 = 0 



N 

^ na n z n ~ l 



for sufficiently small h. 
As we have already indicated, (1), (2), and (3) prove the theorem. | 

Theorem 6 has an obvious corollary: a function represented by a power 
series is infinitely differentiable inside the circle of convergence, and the power 
series is its Taylor series at 0. It follows, in particular, that/ is continuous inside 
the circle of convergence, since a function differentiable at z is continuous at z 
(Problem 25-8). 
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\ 



J 



The continuity of a power series inside its circle of convergence helps explain 
the behavior of certain Taylor series obtained for real functions, and gives the 
promised answers to the questions raised at the end of Chapter 23. We have 
already seen that the Taylor series for the function f(z) = 1/(1 + z 2 ), namely, 



1 - 



converges for real z only when \z\ < 1, and consequently has radius of con- 
vergence 1. It is no accident that the circle of convergence contains the two 
points i and —i at which / is undefined. If this power series converged in a 
circle of radius greater than 1, then (Figure 5) it would represent a function 
which was continuous in that circle, in particular at i and —i. But this is 
impossible, since it equals 1/(1 + z 2 ) inside the unit circle, and 1/(1 + z 2 ) does 
not approach a limit as z approaches i or —i from inside the unit circle. 

The use of complex numbers also sheds some light on the strange behavior 
of the Taylor series for the function 



/(*) = 



0, 



X 0 

x = 0. 



Although we have not yet defined e z for complex z, it will presumably be true 
that if y is real and unequal to 0, then 



/(«» 



-l/fiy)« _ p \\y* 



The interesting fact about this expression is that it becomes large asjy becomes 
small. Thus / will not even be continuous at 0 when defined for complex 
numbers, so it is hardly surprising that it is equal to its Taylor series only for 
z = 0. 

The method by which we will actually define e z (as well as sin z and cos z) 
for complex z should by now be clear. For real x we know that 

x ^ X"* 

sin * = * 1 — • • • , 

3! 5! 

x 2 , x 4 

cos x — l ■ • • 

2! 4! 

e x - 1 +" + —+•* • 
1! 2! 



For complex z we therefore define 



sin z = z 



cos z 



exp(z) 



z 3 z 5 

- + -- 

3! 5! 



z z z* 

1 - - + - + 

2! 4! 

z z 2 

1 +- + - - 

1! 2! 



Then sin' (z) = cos z, cos'(z) = 



— sin z, and exp f (z) = exp(z) by Theorem 6. 
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Moreover, if we replace z by iz in the series for e z > something particularly- 
interesting happens: 

e lz = 1 + iz -\ r ' ' ' 

21 3! 4! 5! 

* 2 wr» z 4 iz' 1 

V 2! 4! / V 3! 5! / 

(this step can be justified by the fact that the series converges absolutely), so 

e iz — cos z _|_ i s [ n z 

It is clear from the definitions (i.e., the power series) that 

sin( — z) = — sin z, 
cos (—z) = cos z, 

so we also have 

g -iz ^ cos z — 2 ' s i n Zt 
From the equations for e iz and we can derive the formulas 



sm z = 



2 l 

cos z = 

2 

The development of complex power series thus places the exponential function 
at the very core of the development of the elementary funotions — it reveals a 
connection between the trigonometric and exponential functions which was 
never imagined when these functions were first defined, and which could never 
have been discovered without the use of complex numbers. As a by-product of 
this relationship, we obtain a hitherto unsuspected connection between the 
numbers e and 7r: if in the formula 

e iz — CQS z _|_ I gj n z 

we take z = 7r, we obtain the remarkable result 

e ir = -1. 

With these remarks we will bring to a close our investigation of complex 
functions. And yet there are still several basic facts about power series which 
have not been mentioned. Thus far, we have seldom considered power series 
centered at a, 

00 

f(z) = ^ «»(* - «)". 

n = 0 

except for a — 0. This omission was adopted partly to simplify the exposition. 
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r\ 

a 









FIGURE 6 



For power series centered at a there are obvious versions of all the theorems in 
this chapter (the proofs require only trivial modifications) : there is a number R 

00 

(possibly 0 or "oo") such that the series ^ a n (z — a) n converges absolutely 

n = 0 

for z with \z — a\ < R, and has unbounded terms for z with \z — a\ > R; 
moreover, for all z with \z — a\ < R the function 

00 

f{z) = I a n {z - a)* 

n = 0 

has derivative 

f(z) - | na n (z-a) n -\ 

n = 1 

It is less straightforward to investigate the possibility of representing a func- 
tion as a power series centered at b, if it is already written as a power series 
centered at a. If 

00 

f(z) = I a n (z - „)» 

71 = 0 

has radius of convergence R y and b is a point with \b — a\ < R (Figure 6), then 
it is true that f(z) can also be written as a power series centered at b, 

f(z) = 2 »•(*- b) n 

n = 0 

(the numbers b n are necessarily f n) (b)/n !); moreover, this series has radius of 
convergence at least R — \b — a\ (it may be larger). 

We will not prove the facts mentioned in the previous paragraph, and there 
are several other important facts we shall not prove. If 

00 00 

f(z) = 2 a ^ z - a ) n and *w = £ *»(* - 

n=0 n=0 

converge in some circle around a, it is certainly to be hoped that f + g and 
/ g will also converge in a circle around a; moreover, ifg(a) ^ 0, the function 
1 /g should have a power series representation. Finally, if 

00 00 

f(z) = 2 ««(* - and g(z) = J 6 n (^ - *)», 

and ^(^) = a, then it should be possible to write / o g as a power series centered 
at 6. 

All of these facts could be proved now without introducing any basic new 
ideas. The treatment off + g is easy, while / • g presents a few problems, and 
\/g presents even more problems. The possibility of changing a power series 
centered at a into one centered at b becomes yet more involved, and the 
treatment offog requires real skill. Rather than end this section with a tour 



Complex Power Series 473 



de force of computations, we will instead give a preview of " complex analysis, 55 
one of the most beautiful branches of mathematics, where all these facts are 
derived as straightforward consequences of some fundamental results. 

Power series were introduced in this chapter in order to provide complex 
functions which are differentiable. Since these functions are actually infinitely 
differentiable, it is natural to suppose that we have therefore selected only a 
very special collection of differentiable complex functions. The basic theorems 
of complex analysis show that this is not at all true: 

If a complex function is defined in some region A of the plane and is differentiable in 
A, then it is automatically infinitely differentiable in A. Moreover, fcr each point a 
in A the Taylor series for f at a will converge to f in any circle contained in A 
(Figure 7). 

These facts are among the first to be proved in complex analysis. It is 
impossible to give any idea of the proofs themselves — the methods used are 
quite different from anything in elementary calculus. If these facts are 
granted, however, then the facts mentioned before can be proved very easily. 

Suppose, for example, that / and g are functions which can be written as 
power series. Then, as we have shown, / and g are differentiable — it then 
follows from easy general theorems that f + g, f ' g, 1/g and fog are also 
differentiable. Appealing to the results from complex analysis, it follows that 
they can be written as power series. 

Similarly, if 

/(*) = £ a n (z - a)» 

n = 0 

has radius of convergence R, then / is differentiable in the region A = 
\z\ \z — a\ < R}. Thus, if b is in A, it is possible to write / as a power series 
centered at b, which will converge in the circle of radius R — \b — a\. This 

00 

series may actually converge in a larger circle, because ^ a n (z — a) n may be 

n = 0 

the series for a function differentiable in a larger region than A. For example, 
suppose that f(z) = 1/(1 + z 2 ). Then / is differentiable, except at i and — i, 

00 

where it is not defined. Thus f(z) can be written as a power series Y a n z n 

n = 0 

with radius of convergence 1 (as a matter of fact, we know that am — (~~l) n 
and a k = 0 if k is odd). It is also possible to write 

00 

f(z) = 2 b n {z - *)", 

n = 0 

where the numbers b n are necessarily b n = f (n) (j)/n\. W e can easily predict 
the radius of convergence of this series: it is Vl + (^-) 2 , the distance from \ 
to i or —i (Figure 8). 
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As an added incentive to investigate complex analysis further, one more 
result will be mentioned, which lies quite near the surface, and which will be 
found in any treatment of the subject. 

For real z the values of sin z always lie between — 1 and 1 , but for complex 
z this is not at all true. In fact, if z = iy, for y real, then 

gi(iy) e -~i(iy) g—y — e y 

sin iy = : = : 

2 l T 

If y is large, then sin iy is also large in absolute value. This behavior of sin is 
typical of functions which are defined and differentiable on the whole complex 
plane (such functions are called entire). A result which comes quite early in 
complex analysis is the following: 

Liouville's Theorem: The only bounded entire functions are the constant functions. 

As a simple application of Liouville's Theorem, consider a polynomial 
function 

f(z) = z n + ai z n ~ + • • • + a H9 

where n > 1, so that /is not a constant. We already know that f(z) is large for 
large z, so Liouville's Theorem tells us nothing interesting about /. But con- 
sider the function 

g & = 7TT 
/0) 

If f(z) were never 0, then g would be entire; since f{z) becomes large for large 
z, the function g would also be bounded, contradicting Liouville's Theorem. 
Thus f(z) = 0 for some z, and we have proved the Fundamental Theorem of 
Algebra. 

PROBLEMS 

1. Decide whether each of the following series converges, and whether it 
converges absolutely. 

n = 1 
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00 



(i v ; 



yiog_« + . B iog». 

L4 n n 

n = 2 

Use the ratio test to show that the radius of convergence of each of the 
following power series is 1. (In each case the ratios of successive terms 
will approach a limit < 1 if \z\ < 1, but for \z\ > 1 the ratios will tend 
to 00 or to a limit > 1.) 

n-\ 

» It 

n = 1 

(iii) 

00 

(iv) ^(« + 2-")^ n . 

00 _ 

(v) ^ 2^ n! . 

Use the root test (Problem 22-7) to find the radius of convergence of each 
of the following power series. 

z , z* z* z* z 6 z* _ _ _ 

.... <?n\z n 
(») > . — ' 



(iv) t**' 

v) ^ 2V ! , 



c 

The root test can always be used, in theory at least, to find the radius of 
convergence of a power series; in fact, a close analysis of the situation 
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leads to a formula for the radius of convergence, known as the "Cauchy- 
Hadamard formula." Suppose first that the set of numbers V|tf n | is 
bounded. 

00 

(a) Use Problem 22-7 to show that if lim V|^ n | z < 1, then Y a n z n 

n ~*~ n = 0 

converges. 

00 

(b) Also show that if lim \Z\a n \ z > 1, then Y a n z n has unbounded 

"-* 00 n = 0 

terms. 

00 

(c) Parts (a) and (b) show that the radius of convergence of ^ a n z n is 

_ n = 0 

1/ihn a/I^I (where "1/0" means " oo"). To complete the formula, 

n—* oo 

define lim V / |^ n | = oo if the set of all ^/\a n \ is unbounded. Prove 

n— +oo 

00 

that in this case, ^ a n z n diverges for z ^ 0, so that the radius of 

n = 0 

convergence is 0 (which may be considered as "1/°°"). 
5. Consider the following three series from Problem 2: 



y^ n , Vx- 

n = 1 n = 1 n = l 



Prove that the first series converges everywhere on the unit circle; that 
the third series converges nowhere on the unit circle; and that the second 
series converges for at least one point on the unit circle and diverges for 
at least one point on the unit circle. 

6. (a) Prove that e z ■ e w = e zJrW for all complex z and w. (You just have to 

imitate the relevant parts of Problem 17-35.) 
(b) Show that sin(z + w) = sin z cos w + cos z sin w and cos(z + w) 
= cos z cos w — sin z sin w for all complex z and w. 

7. (a) Prove that every complex number of absolute value 1 can be written 

e iv for some real number y. 
(b) Prove that \e x + iy \ — e x for real x and y. 

8. (a) Prove that exp takes on every complex value except 0. 
(b) Prove that sin takes on every complex value. 

9. (a) Show that a complex- valued function / = u + iv satisfies the 

equation 

(*) f n) + an-i/^ 15 + • • • + aof = 0, 

if and only if u and v do. Hint: Use Problem 25-9. 
(b) Show that if a = b + ci is a complex root of the equation z n + 
a n -iz n ~ l + ■ * • + a 0 = 0, then /(*) = sin cx and /(*) = 
e bx cos a: are both solutions of (*). 
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10. (a) Show that exp is not one-one on C. 

(b) Given «/^0, show that e z = w if and only if z = # + iy with 
# = log \w\ (here log denotes the real logarithm function), and j> an 
argument of w. 

*(c) Show that there does not exist a continuous function log defined for 
nonzero complex numbers, such that exp (log (z)) = z for all z ^ 0. 
(Show that log cannot even be defined continuously for \z\ — 1.) 

Since there is no way to define a continuous logarithm function we 
cannot speak of the logarithm of a complex number, but only of "a 
logarithm for w," meaning one of the infinitely many numbers z with 
e z = w. 

(d) Find all logarithms for i. 

(e) Find all values of i\ that is, of e iz where z is a logarithm of i. (The 
answers will be real numbers.) 

(f) Show that (1*)* has infinitely many possible values, while 1*** has 
only one. 

11. (a) For real x show that we can choose log(* + i) and \og(x — i) to be 

log (a; + i) — log(l + x 2 ) + t ^ — arctan xj, 

log(x — i) = log(l + x 2 ) — i — arctan xj. 

(It will help to note that t/2 — arctan x = arctan \/x for x ^ 0.) 
(b) The expression 

-L-i(J U 

1 + a: 2 2^ \a: — ? ^ + z/ 

yields, formally, 

^ 1 



/ 



, [log(* - 0 - log(^ + 0]. 



1 + x 2 2i 

Use part (a) to check that this answer agrees with the usual one. 

12. (a) A sequence {a n } of complex numbers is called a Cauchy sequence 

if lim \a m — a n \ = 0. Suppose that a n = b n + ic n , where b n and 

m,n—> oo 

c n are real. Prove that {a n } is a Cauchy sequence if and only if 
\b n ] and {c n } are Cauchy sequences. 

(b) Prove that every Cauchy sequence of complex numbers converges. 

(c) Give direct proofs, without using theorems about real series, that an 
absolutely convergent series is convergent and that any rearrange- 
ment has the same sum. (It is permitted, and in fact advisable, to 
use the proofs of the corresponding theorems for real series.) 
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13. Prove the formula 

1 sin (n + i)6 
- + cos 8 + cos 26 + • • ■ + cos nd = — > 

2 2 sin* 

2 

by writing cos nd = (^ n * + e~ in6 )/2, summing the resulting geometric 
series, and multiplying top and bottom by e~ i9l K 

14. Let {a n } be the Fibonacci sequence, a\ = a 2 — 1, a n+2 — a n + a n+ \. 

(a) If r n - ^n+iAn, show that r n +i = 1 + l/r„. 

(b) Show that r = lim r n exists, and r = 1 + 1/r. Conclude that 

n — > oo 

r = (1 + V5)/2. 

(c) Show that ^ fl n ^ n has radius of convergence 2/(1 + \/S). (Using 

n = 1 

oo 

the unproved theorems in this chapter, and the fact that ^ a n z n — 

n — l 

-\/{z 2 + z - 1) from Problem 23-8, we could have predicted that 
the radius of convergence is the smallest absolute value of the roots 
of z 2 + z - 1 = 0; since the roots are (-1 ± "V / 5)/2, the radius 
of convergence should be (-!_ + Vs)/2. Notice that this number 
is indeed equal to 2/(1 + Vs).) 

15. Since (** - 1)A can be written as the power series 1 + z/2\ + z 2 /3\ 
+ • • • which is nonzero at 0, it follows that if g(z) = z/(e z — 1) for 
z 0, and g(0) = 1, then ^ is differentiate inside some circle around 0. 
It then follows from the unproved theorem in this chapter that there is a 
power series 



z V K 
- 1 Lf n\ 

n = 0 



with nonzero radius of convergence. We can even predict the radius of 
convergence; it is 2tt, since this is the smallest absolute value of the num- 
bers z = Ikiri for which <?* - 1 = 0. The numbers b n appearing here 
are called the Bernoulli numbers.* 

(a) Clearly b 0 = g(0) = 1. Now show that 

z _ _ z z_ e z + 1 



e z - \ 2 2^-1 

e~ z + 1 e*+l 



e~ z - 1 e z - 1 

* Sometimes the numbers fl n = (-l)"-^ 2 « are called the Bernoulli numbers, because b n = 0 
if n is odd and > 1 (see part ((a)) and because the numbers b 2n alternate in sign, although we 
will not prove this. Other modifications of this nomenclature are also in use. 



Complex Power Series 479 



and deduce that 

b l = b n = 0 if 72 is odd and n > 1. 

(b) By finding the coefficient of z n in the right side of the equation 



z 

show that 



SO- 



0 for n > 1. 



This formula allows us to compute any b k in terms of previous ones, 
and shows that each is rational. Calculate two or three of the 
following: 

b 2 = bi = "Mi = 4V5 = 

*(c) Part (a) shows that 



_i_ 

" 3 0- 



(In 



b 2n , 2n z e>+\ z + 



(2n) ! 2 e* - 1 2 e 2 ' 2 - ^ 2/2 

n = U 

Replace z by 2iz and show that 

00 

b<i n . *\n^<Ln„in 

zcotz= A(2T! (_1) 2 2 • 

*(d) Show that 



n = 0 



tan z = cot z — 2 cot 2z. 



*(e) Show that 



tan z = 



00 

V ^ 2n (-\)n-i2 2n (2 2n - \)z 2n ~\ 
Li (2ft) ! ■ 



(This series converges for |*| < 7r/2.) 

The Bernoulli numbers play an important role in a theorem which is 
best introduced by some notational nonsense. Let us use D to denote the 
"differentiation operator," so that Df denotes /'. Then D k f will mean 

f (k) and e D f will mean £ / (n) A! (of course this series makes no sense in 

71 = 0 

general, but it will make sense if /is a polynomial function, for example). 
Finally, let A denote the "difference operator" for which Af(x) = 
f( x _|_ i) - f( x y Now Taylor's Theorem implies, disregarding questions 
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of convergence, that 



or 




n = l 



we may write this symbolically as A/ = — 1)/, where 1 is the 
"identity operator." Even more symbolically this can be written 
A = e D — 1, which suggests that 



Thus we obviously ought to have 



The beautiful thing about all this nonsense is that it works ! 

(a) Prove that (**) is literally true if / is a polynomial function (in 
which case the infinite sum is really a finite sum). Hint: By applying 
(*) to f k \ find a formula for /<*>(* + 1) - /<*>(*); then use the 
formula in Problem 15(b) to find the coefficient of f ij) (x) in the 
right side of (**). 

(b) Deduce from (**) that 




i.e. 




00 




(c) 



Show that for any polynomial function g we have 



g(0) + 



• • • + g(n) = f^git) dt + £ £ [*<*-»(!, + 1) - g«-»(0)l 



(d) 



Apply this to g(x) = x v to show that 
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Using the fact that bi = — h show that 



The first ten instances of this formula were written out in Problem 
2-6, which offered as a challenge the discovery of the general pattern. 
This may now seem to be a preposterous suggestion, but the Ber- 
noulli numbers were actually discovered in precisely this way! After 
writing out these 10 formulas, Bernoulli claims (in his posthumously 
printed work Ars Conjectandi, 1713): " Whoever will examine the 
series as to their regularity may be able to continue the table. 55 He 
then writes down the above formula, offering no proof at all, merely 
noting that the coefficients b k (which he denoted simply by A, B, 
C, . . .) satisfy the equation in Problem 15(b). The relation be- 
tween these numbers and the coefficients in the power series for 
z/{f — 1) was discovered by Euler. 

The formula in Problem 16(c) can be generalized to the case where g is 
not a polynomial function; the infinite sum must be replaced by a finite 
sum plus a remainder term. In order to find an expression for the 
remainder, it is useful to introduce some new functions. 

(a) The Bernoulli polynomials <p n are defined by 



71 




The first three are 



<Pi(x) 




Show that 



*>n(0) = b n , 

<Pn(X) = b n if Tl > 1, 

(p n '(x) = n<p n -i(x), 

*>n« = (-l)Vn(l -*) for,* > 1. 



Hint: Prove the last equation by induction on «, starting with n - 
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(b) Let R N k (x) be the remainder term in Taylor's formula for f k \ on the 
interval [x, x + 1], so that 



N 

U+n)( 



(*) /<*>(* + 1) - fM( X ) = V ^— ^ + 



Prove that 

AT 



fW = Xir* [/U>( * + 0 ~ /<4)W] ~% b i RN - 



Hint: Imitate Problem 16(a). Notice the subscript N — k on R. 
(c) Use the integral form of the remainder to show that 



4 = 0 

(d) Deduce the "Euler-Maclaurin Summation Formula": 
*(*) +*(* + 1) + • • • + g(x + n) 

N 

= J^" +l s(t) dt + V £ lgV°-»(x + n-l)- g<*-*>(x)] + S K (x, n), 
where 

i = o 

(e) Let \// n be the periodic function, with period 1, which satisfies 
$n(t) = <p n (t) for 0 < / < 1. (Part (a) implies that if n > 1, then 
^ n is continuous, since <p n (l) = <p n (0), and also that <p n is even if n is 
even and odd if n is odd.) Show that 

Unlike the remainder in Taylor's Theorem, the remainder Sn(x, n) usually 
does not satisfy lim S N (x, n) = 0, because the Bernoulli numbers and func- 

tions become large very rapidly (although the first few examples do not suggest 
this). Nevertheless, important information can often be obtained from the 
summation formula. The general situation is best discussed within the context 
of a specialized study ("asymptotic series"), but the next problem shows one 
particularly important example. 
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*18. (a) Use the Euler-Maclaurin Formula, with N = 2, to show that 

/ n 1 [ n ^(0 

logtdt--logn + J i — dt. 

(b) Show that 

(c) Explain why the improper integral 0 = | t " fa(t)/2t 2 dt exists, and 
show that if a = then 

g \a/2» +1 ' V"V Jn It 2 

(d) Problem 18-26(d) shows that 

V^r = lim 



0z!) 2 2 2 " 



(2n) ! 

Use part (c) to show that 

/- a 2 n 2n+1 e- 2n 2 2n 

V 7r = lim 7=> 

a(2n) 2w " H/ V~ 2B Vn 

and conclude that o: = V2^. 
(e) Show that the maximum value of \(p*(x)\ for x in [0, 1] is £, so that 

1 



i/: 



*J 4 

2/ 2 



< 
" 12w 



Conclude that 

W »+1/2<T»-1/I2n < „! < ^+l/V" n+1/12n . 

The final result of Problem 18, a strong form of Stirling's Formula, shows 
that n ! is approximately V / 2tt w n+1/2 <T n , in the sense that this expression differs 
from n ! by an amount which is small compared to n when n is large. For exam- 
ple, for n = 10 we obtain 3598696 instead of 3628800, with an error <1%. 

A more general form of Stirling's Formula illustrates the " asymptotic 5 5 
nature of the summation formula. The same argument which was used in 
Problem 18 can now be used to show that for iV > 2 we have 

i ( ni \ = v bk + r ^ dt 
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Since \j/ N is bounded, we can obtain estimates of the form 



1/ 



00 jMf) 

tV! t N 



dt 



< 



Mn 



UN is large, the constant M N will also be large; but for very large n the factor 
n 1 N will make the product very small. Thus, the expression 

N 

V^r> + l/2,-n . ( y ** \ 

may be a very bad approximation for n! when * is small, but for large n (how 
large depends on N) it will be an extremely good one {how good depends on N). 



There was a most ingenious Architect 
who had contrived a new Method 
for building Houses, 
by beginning at the Roof, and working 
downwards to the Foundation. 



JONATHAN SWIFT 




PART 
EPILOGUE 



CHAPTER tff I FIELDS 



Throughout this book a conscientious attempt has been made to define all 
important concepts, even terms like "function," for which an intuitive defini- 
tion is often considered sufficient. But Q, and R, the two main protagonists of 
this story, have only been named, never defined. What has never been defined 
can never be analyzed thoroughly, and "properties" PI -PI 3 must be con- 
sidered assumptions, not theorems, about numbers. Nevertheless, the term 
"axiom" has been purposely avoided, and in this chapter the logical status 
of PI -PI 3 will be scrutinized more carefully. 

Like Q, and R, the sets N and Z have also remained undefined. True, some 
talk about all four was inserted in Chapter 2, but those rough descriptions are 
far from a definition. To say, for example, that N consists of 1, 2, 3, etc., 
merely names some elements of N without identifying them (and the "etc." is 
useless). The natural numbers can be defined, but the procedure is involved 
and not quite pertinent to the rest of the book. The Suggested Reading list 
contains references to this problem, as well as to the other steps that are 
required if one wishes to develop calculus from its basic logical starting point. 
The further development of this program would proceed with the definition 
of Z, in terms of N, and the definition of Q in terms of Z. This program results 
in a certain well-defined set Q, certain explicitly defined operations + and •, 
and properties PI -PI 2 as theorems. The final step in this program is the con- 
struction of R, in terms of Q,. It is this last construction which concerns us. 
Assuming that Qhas been defined, and that PI -PI 2 have been proved for Q, 
we shall ultimately define R and prove all of PI -PI 3 for R. 

Our intention of proving PI -PI 3 means that we must define not only real 
numbers, but also addition and multiplication of real numbers. Indeed, the 
real numbers are of interest only as a set together with these operations: how 
the real numbers behave with respect to addition and multiplication is crucial; 
what the real numbers may actually be is quite irrelevant. This assertion can 
be expressed in a meaningful mathematical way, by using the concept of a 
"field," which includes as special cases the three important number systems 
of this book. This extraordinarily important abstraction of modern mathe- 
matics incorporates the properties P1-P9 common to Q,, R, and C. A field is 
a set F (of objects of any sort whatsoever), together with two "binary oper- 
ations" + and • defined on F (that is, two rules which associate to elements 
a and b in F, other elements a + b and a • b in F) for which the following con- 
ditions are satisfied: 

(1) {a + b) + c = a + (b + c) for all a, b, and c in F. 

(2) There is some element 0 in F such that 

(i) a + 0 = a for all a in F, 

(ii) for every a in F, there is some element b in F such that a + b = 0. 
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(3) a + b = b + a for all a and b in F. 

(4) (a • b) • c = a - (b * c) for all a, b, and c in F. 

(5) There is some element 1 in F such that 1^0 and 

(i) a • 1 = a for all a in F, 

(ii) For every a in F with a 0, there is some element b in F such 
that a • b = 1. 

(6) a * b = b • a for all a and 6 in F 

(7) <z • (b + c) = a • b + a • c for all a, 6, and c in F 

The familiar examples of fields are, as already indicated, Q,, R, and C, with 
+ and • being the familiar operations of + and \ It is probably unnecessary 
to explain why these are fields, but the explanation is, at any rate, quite brief. 
When + and • are understood to mean the ordinary + and the rules 1, 3, 
4, 6, 7 are simply restatements of PI, P4, P5, P8, P9; the elements which play 
the role of 0 and 1 are the numbers 0 and 1 (which accounts for the choice of 
the symbols 0, 1); and the number b in (2) or (5) is -a or aT\ respectively. 
(For this reason, in an arbitrary field F we denote by —a the element such that 
a + (_ fl ) = 0, and by a -1 the element such that a • a" 1 = 1, for a ^ 0.) 

In addition to Q,, R, and C, there are several other fields which can be 
described easily. One example is the collection F Y of all numbers a + b V2 
for a, b in Q The operations + and • will, once again, be the usual + and ■ 
for real numbers. It is necessary to point out that these operations really do 
produce new elements of F\\ 

{a + b V2) + (c + d V2) = (a + c) + (b + d) V2, which is in F i; 
{a + b V2) * (c + d V2) = (ac + 2bd) + (be + ad) V 2, which is in Fl 

Conditions (1), (3), (4), (6), (7) for a field are obvious for Fu since these hold 
for all real numbers, they certainly hold for all real numbers of_the form 
a _|_ & V2. Condition (2) holds because the number 0 = 0 + 0 V2_is in Fi 
and, for a = a + b V2 in Fi the number j3 = (-a) + ( — b) V2 in Fi 
satisfies a + 0 = 0. Similarly, 1 = 1 + 0 V2 is in Fi, so (5i) is satisfied. 
The verification of (5ii) is the only slightly difficult point. If a + b V2 ^ 0, 
then 

a + b V2 1 — 7= = 1; 

<z + 6V2 

it is therefore necessary to show that \/(a + b Vl) is in Fi. This is true 
because 

1 _ a - bV2 ^ a , J^llL V2 

aTTVl " ( fl - A V2)( fl + b V~2) a*-2b> a* -2b* 

(The division by a - b V2 is valid because the relation a - 6 = 0 could 
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be true only if a = b = 0 (since V2" is irrational) which is ruled out by the 
hypothesis a + b V2 0.) 

The next example of a field, F 2 , is considerably simpler in one respect: it con- 
tains only two elements, which we might as well denote by 0 and 1. The 
operations + and • are described by the following tables. 



+ 


0 


1 




0 


1 


0 


0 


1 


0 


0 


0 


1 


1 


0 


1 


0 


1 



The verification of conditions (l)-(7) are straightforward, case-by-case 
checks. For example, condition (1) may be proved by checking the 8 equations 
obtained by setting a, b, c — 0 or 1. Notice that in this field 1 + 1 = 0; this 
equation may also be written 1 = — 1. 

Our final example of a field is rather silly: F 3 consists of all pairs (0, a) for 
a in R, and + and • are defined by 

(a, a) + (b, b) = (a + b,a + b), 
(a, a) - (b, b) = {a * b, a • b). 

(The + and ■ appearing on the right side are ordinary addition and multipli- 
cation for R.) The verification that F z is a field is left to you as a simple 
exercise. 

A detailed investigation of the properties of fields is a study in itself, but 
for our purposes, fields provide an ideal framework in which to discuss the 
properties of numbers in the most economical way. For example, the conse- 
quences of P1-P9 which were derived for "numbers" in Chapter 1 actually 
hold for any field; in particular, they are true for the fields Q, R, and C. 

Notice that certain common properties of Q, R, and C do not hold for all 
fields. For example, it is possible for the equation 1 + 1 = 0 to hold in some 
fields, and consequently a — b = b — a does not necessarily imply that 
a = b. For the field C the assertion 1 + 1^0 was derived from the explicit 
description of C; for the fields Qand R, however, this assertion was derived from 
further properties which do not have analogues in the conditions for a field. 
There is a related concept which does use these properties. An ordered field 
is a field F (with operations + and •) together with a certain subset P of F 
(the "positive" elements) with the following properties: 

(8) For all a in F, one and only one of the following is true: 

(i) a = 0, 

(ii) a is in P, 

(iii) — a is in P. 

(9) If a and b are in P, then a + b is in P. 
(10) If a and b are in P, then a • b is in P. 



We have already seen that the field C cannot be made into an ordered field. 
The field F 2 , with only two elements, likewise cannot be made into an ordered 
field: in fact, condition (8), applied to 1 = — 1, shows that 1 must be in P; 
then (9) implies that 1 + 1 = 0 is in P, contradicting (8). On the other hand, 
the field F h consisting of all numbers a + b V2 with a, b in Q, certainly can 
be made into an ordered field: let P be the set of all a + which are 

positive real numbers (in the ordinary sense). The field F s can also be made 
into an ordered field; the description of P is left to you. 

It is natural to introduce notation for an arbitrary ordered field which 
corresponds to that used for Q, and R : we define 

a > b if a — b is in P, 

a < b if b > a, 

a < b if a < b or a = b, 

a > b if a > b or a = b. 

Using these definitions we can reproduce, for an arbitrary ordered field F, 
the definitions of Chapter 7: 

A set A of elements of Fis bounded above if there is some x in Fsuch that 
x > a for all a in A. Any such x is called an upper bound for A. An ele- 
ment x of F is a least upper bound for A if x is an upper bound for A and 
x < y for every y in F which is an upper bound for A. 

Finally, it is possible to state an analogue of property PI 3 for R; this leads to 
the last abstraction of this chapter: 

A complete ordered field is an ordered field in which every nonempty 
set which is bounded above has a least upper bound. 

The consideration of fields may seem to have taken us far from the goal of 
constructing the real numbers. However, we are now provided with an 
intelligible means of formulating this goal. There are two questions which 
will be answered in the remaining two chapters: 

1. Is there a complete ordered field? 

2. Is there only one complete ordered field? 

Our starting point for these considerations will be Q,, assumed to be an 
ordered field, containing N and Z as certain subsets. At one crucial point it 
will be necessary to assume another fact about Q: 

Let x be an element of Q, with x > 0, Then for any^ in Q, there is some n 
in N such that nx > y. 

This assumption, which asserts that the rational numbers have the Archi- 
median property of the reals, does not follow from the other properties of an 
ordered field (for the example that demonstrates this conclusively see [17]). 
The important point for us is that when Q, is explicitly constructed, proper- 
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ties PI -PI 2 appear as theorems, and so does this additional assumption; 
if we really began from the beginning, no assumptions about Q, would be 
necessary. 

PROBLEMS 

1. Let F be the set {0, 1, 2} and define operations + and • on F by the 
following table. (The rule for constructing this table is as follows: add or 
multiply in the usual way, and then subtract the highest possible multiple 
of 3; thus 2 ■ 2 = 4 = 3 + 1, so 2 • 2 = 1.) 



+ 


0 


1 


2 




0 


1 


2 


0 


0 


1 


2 


0 


0 


0 


0 


1 


1 


2 


0 


1 


0 


1 


2 


2 


2 


0 


1 


2 


0 


2 


1 



Show that F is a field, and prove that it cannot be made into an ordered 
field. 

2. Suppose now that we try to construct a field F having elements 0, 1, 2, 3 
with operations + and • defined as in the previous example, by adding 
or multiplying in the usual way, and then subtracting the highest possible 
multiple of 4. Show that F will not be a field. 

3. Let F = {0, 1, a, 0} and define operations + and • on Fby the follow- 
ing tables. 



+ 


0 


1 


a 


0 




0 


1 


a 


0 


0 


0 


1 


a 


0 


0 


0 


0 


0 


0 


1 


1 


0 


/3 


OL 


1 


0 


1 


a 




a 


a 




0 


1 


a 


0 


a 




1 


0 




a 


1 


0 




0 


0 


1 


a 



Show that F is a field. 



4. (a) Let F be a field in which 1 + 1 = 0. Show that a + a = 0 for all 
a (this can also be written a = — a). 
(b) Suppose that a + a = 0 for some a ^ 0. Show that 1 + 1 = 0 (and 
consequently £ + £ = 0 for all b). 
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5. (a) Show that in any field we have 

m times n times mn times 

for all natural numbers m and n. 
(b) Suppose that in the field F we have 

1+^^+1 = o 

m times 

for some natural number m. Show that the smallest m with this 
property must be a prime number (this prime number is called the 
characteristic of F) . 

6. Let F be any field with only finitely many elements. 

(a) Show that there must be distinct natural numbers m and n with 

m times n times 

(b) Conclude that there is some natural number k with 

M^_^fi = o. 

k times 

7. Let a, b, c, and d be elements of a field F with a • — 6 • c ^ 0. Show 
that the equations 

a • x + £ • j; = a, 

£ • at d * y = /3, 

can be solved for x and y. 

8. Let a be an element of a field F. A "square root" of a is an element b of 
.Pwith b 2 = b • b = a. 

(a) How many square roots does 0 have? 

(b) Suppose a ^ 0. Show that a has two square roots, unless 1 + 1 = 0, 
in which case a has only one. 

9. (a) Consider an equation x 2 + b • x + c = 0, where b and c are elements 

of a field F. Suppose that b 2 — 4 • c has a square root r in F. Show 

that ( — b + r)/2 is a solution of this equation, 
(b) In the field F 2 of the text, both elements clearly have a square root. 

On the other hand, it is easy to check that neither element satisfies 

the equation x 2 + x + 1 = 0. Thus some detail in part (a) must 

be incorrect. What is it? 
10. Let F be a field and a an element of F which does not have a square root. 
This problem shows how to construct a bigger field F\ containing F, in 
which a does have a square root. (This construction has already been 
carried through in a special case, namely, F = R and a = — 1 ; this 
special case should guide you through this example.) 
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Let F' consist of all pairs (x, y) with x and y in F. If the operations on F 
are + and define operations 0 and O on F' as follows: 

0, y) 0 (z } w) = (x + z, y + w), 

(x, y) O w) = (# • z + a • • w, y • z + x • a>) . 

(a) Prove that jF', with the operations 0 and O, is a field. 

(b) Prove that 

(x, 0) 0 (y, 0) = (x+y, 0), 
(x, 0) 0 (y, 0) = 0), 

so that we may agree to abbreviate (at, 0) by 

(c) Find a square root of a = (a, 0) in F' . 

Let F be the set of all four-tuples (w, x, y, z) of real numbers. Define 
+ and • by 

(s, t, u, v) + (w, x,y,z) = (s + w, t + x, u + y, v + z), 
, u, v) • (w, x, y, z) — (sw — tx — uy — vz, sx + tw + uz — vy, 

sy + uw + vx — tz, sz + vw + ty — ux). 

(a) Show that F satisfies all conditions for a field, except (6). At times 
the algebra will become quite ornate, but the existence of multi- 
plicative inverses is the only point requiring any thought. 

(b) It is customary to denote 

(0, 1,0,0) byi, 
(0, 0,1,0) by;, 
(0, 0,0, 1) by k. 

Find all 9 products of pairs i, j, and k. The results will show in par- 
ticular that condition (6) is definitely false. This "skew field" F is 
known as the quarternions. 
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CONSTRUCTION OF THE 
REAL NUMBERS 



The mass of drudgery which this chapter necessarily contains is relieved by 
one truly first-rate idea. In order to prove that a complete ordered field exists 
we will have to explicitly describe one in detail; verifying conditions (1)— (10) 
for an ordered field will be a straightforward ordeal, but the description of the 
field itself, of the elements in it, is ingenious indeed. 

At our disposal is the set of rational numbers, and from this raw material 
it is necessary to produce the field which will ultimately be called the real 
numbers. To the uninitiated this must seem utterly hopeless — if only the 
rational numbers are known, where are the others to come from? By now we 
have had enough experience to realize that the situation may not be quite so 
hopeless as that casual consideration suggests. The strategy to be adopted in 
our construction has already been used effectively for defining functions and 
complex numbers. Instead of trying to determine the "real nature" of these 
concepts, we settled for a definition that described enough about them to 
determine their mathematical properties completely. 

A similar proposal for defining real numbers requires a description of real 
numbers in terms of rational numbers. The observation, that a real number 
ought to be determined completely by the set of rational numbers less than it, 
suggests a strikingly simple and quite attractive possibility: a real number 
might (and in fact eventually will) be described as a collection of rational 
numbers. In order to make this proposal effective, however, some means must 
be found for describing "the set of rational numbers less than a real number' 5 
without mentioning real numbers, which are still nothing more than heuristic 
figments of our mathematical imagination. 

If A is to be regarded as the set of rational numbers which are less than the 
real number a, then A ought to have the following property: If x is in A andy 
is a rational number satisfying y < x, then y is in A. In addition to this 
property, the set A should have a few others. Since there should be some 
rational number x < a, the set A should not be empty. Likewise, since there 
should be some rational number x > a, the set A should not be all of Q,. 
Finally, if x < a, then there should be another rational number y with 
x < y < a, so A should not contain a greatest member. 

*If we temporarily regard the real numbers as known, then it is not hard to 
check (Problem 8-17) that a set A with these properties is indeed the set of 
rational numbers less than some real number a. Since the real numbers are 
presently in limbo, your proof, if you supply one, must be regarded only as an 
unofficial comment on these proceedings. It will serve to convince you, how- 
ever, that we have not failed to notice any crucial property of the set A. There 
appears to be no reason for hesitating any longer. 
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DEFINITION 



A real number is a set a, of rational numbers, with the following four 
properties: 

(1) If x is in a and^ is a rational number withjy < x, thenjy is also in a. 

(2) OL * 0. 

(3) a * Q. 

(4) There is no greatest element in a\ in other words, if x is in a, then 
there is some y in a with y > x. 

The set of all real numbers is denoted by R. 



Just to remind you of the philosophy behind our definition, here is an 
explicit example of a real number: 

a = \x in Q: # < 0 or x 2 < 2} . 

It should be clear that a is the real number which will eventually be known 
as V2, but it is not an entirely trivial exercise to show that a actually is a 
real number. The whole point of such an exercise is to prove this using only 
facts about Q; the hard part will be checking condition (4), but this has already 
appeared as a problem in a previous chapter (finding out which one is up to 
you). Notice that condition (4), although quite bothersome here, is really 
essential in order to avoid ambiguity; without it both 

\ x in Q: x < 1} 

and 

{x in Q/. x < 1} 

would be candidates for the "real number 1." 

The shift from A to a in our definition indicates both a conceptual and a 
notational concern. Henceforth, a real number is, by definition, a set of 
rational numbers. This means, in particular, that a rational number (a 
member of Q) is not a real number; instead every rational number x has a 
natural counterpart which is a real number, namely, {y in Q: y < x). After 
completing the construction of the real numbers, we can mentally throw away 
the elements of Q and agree that Q will henceforth denote these special sets. 
For the moment, however, it will be necessary to work at the same time with 
rational numbers, real numbers (sets of rational numbers) and even sets of 
real numbers (sets of sets of rational numbers). Some confusion is perhaps 
inevitable, but proper notation should keep this to a minimum. Rational 
numbers will be denoted by lower case Roman letters (x, y, z, a, b, c) and 
real numbers by lower case Greek letters (ex, /3, 7) ; capital Roman letters 
(A, B, C) will be used to denote sets of real numbers. 

The remainder of this chapter is devoted to the definition of +, •, and P 
for R, and a proof that with these structures R is indeed a complete ordered 
field. 
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We shall actually begin with the definition of P, and even here we shall 
work backwards. We first define a < P; later, when +, and 0 are available, 
we shall define P as the set of all a with 0 < a, and prove the necessary 
properties for P. The reason for beginning with the definition of < is the 
simplicity of this concept in our present setup: 

Definition. If a and p are real numbers, then a < P means that a is contained 
in P (that is, every element of a is also an element of/3), but a ^ p. 

A repetition of the definitions of <, >, > would be stultifying, but it is 
interesting to note that < can now be expressed more simply than < ; if a and 
P are real numbers, then a < P if and only if a is contained in p. 

If A is a bounded collection of real numbers, it is almost obvious that A 
should have a least upper bound. Each a in A is a collection of rational num- 
bers; if these rational numbers are all put in one collection P, then P is pre- 
sumably sup A. In the proof of the following theorem we check all the little 
details which have not been mentioned, not least of which is the assertion that 
P is a real number. (We will not bother numbering theorems in this chapter, 
since they all add up to one big Theorem: There is a complete ordered field.) 

theorem If A is a set of real numbers and A ^ 0 and A is bounded above, then A has a 
least upper bound. 

PROOF Let P = {x: x is in some a in A}. Then p is certainly a collection of rational 
numbers; the proof that P is a real number requires checking four facts. 

(1) Suppose that x is in P and y < x. The first condition means that x is 
in a for some a in A. Since a is a real number, the assumption y < x 
implies that y is in a. Therefore it is certainly true that y is in p. 

(2) Since A ^ 0, there is some a in A. Since a is a real number, there is 
some x in a. This means that x is in P, so p ^ 0. 

(3) Since A is bounded above, there is some real number y such that 
a < 7 for every a in A. Since 7 is a real number, there is some 
rational number x which is not in 7. Now a < 7 means that a is 
contained in 7, so it is also true that x is not in a for any a in A. This 
means that x is not in p; so P ^ Q. 

(4) Suppose that x is in p. Then x is in a for some a in A. Since a does 
not have a greatest member, there is some rational number y with 
x < y and y in a. But this means that y is in p; thus P does not have 
a greatest member. 

These four observations prove that P is a real number. The proof that P is 
the least upper bound of A is easier. If a is in A, then clearly a is con- 
tained in P; this means that a < P, so P is an upper bound for A. On the other 
hand, if 7 is an upper bound for A, then a < 7 for every a in A; this means 
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that a is contained in 7, for every a in A, and this surely implies that 0 is con- 
tained in y. This, in turn, means that 0 < y ; thus 0 is the least upper bound 
of A. I 

The definition of + is both obvious and easy, but it must be complemented 
with a proof that this ' 'obvious' 5 definition makes any sense at all. 

Definition. If a and 0 are real numbers, then 

a + 0 = {x: x = y + z for some y in a and some z in 0). 



THEOREM If a and 0 are real numbers, then a + £ is a real number. 

PROOF Once again four facts must be verified. 

(1) Suppose w < x for some x in a + /3. Then a: = jy + 2- for some)' in a 
and some z in /3, which means that w < y + z, and consequently, 
w — y < z. This shows that w — y is in 0 (since ^ is in 0, and ^ is a 
real number). Since w = y + (w — y), it follows that 2x> is in a + 

(2) It is clear that a + 0 0, since a 5^ 0 and /3 0. 

(3) Since a and 0 5* Q, there are rational numbers a and b with a 
not in a and 6 not in 0. Any x in a satisfies # < a (for if a < *, then 
condition (1) for a real number would imply that a is in a); similarly 
any y in 0 satisfies y < b. Thus x + < a + £ for any x in a and ^ 
in 0. This shows that a + 6 is not in o: + 0, so a + /3 ^ Q,. 

(4) If x is in a + /3, then a: = y + ^ for y in a and z in 0. There are 
/ in a and in 0 with _y < / and z < z f ; then x < y f + z f and 
_/ + is in a + Thus a + 0 has no greatest member. | 



By now you can see how tiresome this whole procedure is going to be. Every 
time we mention a new real number, we must prove that it is a real number; 
this requires checking four conditions, and even when trivial they require 
concentration. There is really no help for this (except that it will be less 
boring if you check the four conditions for yourself) . Fortunately, however, a 
few points of interest will arise now and then, and some of our theorems will be 
easy. In particular, two properties of + present no problems. 

THEOREM If a, 0, and 7 are real numbers, then (a + 0) + 7 = a + (0 + 7). 

PROOF Since (x + y) + z = x + (y + z) for all rational numbers x, y, and z, every 
member of (a + 0) + 7 is also a member of a + (0 + y)> and vice versa. | 

theorem If a and 0 are real numbers, then a + 0 = 0 + a. 



PROOF 



Left to you (even easier). | 
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To prove the other properties of + we first define 0. 
Definition. 0 = {x in Q: x < 0}. 

It is, thank goodness, obvious that 0 is a real number, and the following 
theorem is also simple. 



THEOREM If a is a real number, then a + 0 = a. 

PROOF If * is in a and y is in 0, then y < 0, so x + y < x. This implies that x + y is 
in a. Thus every member of a + 0 is also a member of a. 

On the other hand, if x is in a, then there is a rational number y in a such 
that y > x. Since x = y + (x — y), where y is in a, and x — y < 0 (so that 
* - y is in 0), this shows that x is in a + 0. Thus every member of a is also a 
member of a + 0. | 

The reasonable candidate for —a would seem to be the set 
{x in Q,: — x is not in a} 

(since —x not in a means, intuitively, that — x > a, so that x < — a). But in 
certain cases this set will not even be a real number. Although a real number 
a does not have a greatest member, the set 

Q — a — { x in Q,: x is not in a } 

may have a element x 0 ; when a is a real number of this kind, the set 
{x: —x is not in a } will have a greatest element —x 0 . It is therefore necessary 
to introduce a slight modification into the definition of —a, which comes 
equipped with a theorem. 

Definition. If a is a real number, then 

—a = {x in Q: —* is not in a, but — x is not the least element of Q — a}. 



THEOREM If a is a real number, then —a is a real number. 

PROOF (1) Suppose that x is in —a and y < x. Then — y > —x. Since —x is not 

in a, it is also true that — y is not in a. Moreover, it is clear that — y is 
not the smallest element of Q, - a, since —x is a smaller element. 
This shows that jy is in — a. 

(2) Since a ^ Q,, there is some rational number which is not in a. We 
can assume that y is not the smallest rational number in Q, — a 
(since can always be replaced by any y 1 > y). Then —y is in —a. 
Thus —a 9* 0. 

(3) Since a ^ 0, there is some x in a. Then — * cannot possibly be in —a, 
so —a ^ Q. 
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(4) If x is in — a, then —x is not in a, and there is a rational number 
y < — x which is also not in a. Let z be a rational number with 
y < z < —.v. Then z is also not in a, and z is clearly not the smallest 
element of Q — a. So — z is in — a. Since — z > x, this shows that 
— a does not have a greatest element. | 

The proof that a + ( — a) = 0 is not entirely straightforward. The diffi- 
culties are not caused, as you might presume, by the finicky details in the 
definition of — a. Rather, at this point we require the Archimedian property of 
Q, stated on page 490, which does not follow from PI -PI 2. This property 
is needed to prove the following lemma, which plays a crucial role in the next 
theorem. 

LEMMA Let a be a real number, and z a positive rational number. Then there are 
(Figure 1) rational numbers x in a, and;? not in a, such thatjy — x = z. More- 
over, we may assume that y is not the smallest element of Q, — a. 

PROOF Suppose first that z is in a. If the numbers 

z 3 2z, 3z, . . . 

were all in a, then every rational number would be in a, since every rational 
number w satisfies w < nz for some w, by the additional assumption on page 
490. This contradicts the fact that a is a real number, so there is some k such 
that x — kz is in a and y = (k + \)z is not in a. Clearly y — x = z. 

Moreover, if y happens to be the smallest element of Q, — a, let x r > x be 
an element of a, and replace x by x\ and y by y + (V — x). 

If z is not in a, there is a similar proof, based on the fact that the numbers 
( — n)z cannot all fail to be in a. | 



x y 

FIGURE 1 

THEOREM If a is a real number, then 

a + (—a) = 0. 

PROOF Suppose * is in a and y is in —a. Then — y is not in a, so — y > x. Hence 
x + y < 0, so x + y is in 0. Thus every member of a + (—a) is in 0. 

It is a little more difficult to go in the other direction. If z is in 0, then 
— z > 0. According to the lemma, there is some x in a, and some y not in a, 
with;/ not the smallest element of Q — a, such that;; — x = —z. This equa- 
tion can be written x + (—y) = z. Since x is in «, and — y is in — «, this 
proves that z is in a + ( — a). | 
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Before proceeding with multiplication, we define the "positive elements" 
and prove a basic property: 

Definition. P = {a in R: a > 0}. 

Notice that a + /? is clearly in P if a and 0 are. 

THEOREM If a is a real number, then one and only one of the following conditions holds: 

(i) a = 0, 

(ii) a is in P, 

(iii) —a is in P. 

PROOF If a contains any positive rational number, then a certainly contains all nega- 
tive rational numbers, so a contains 0 and a ^ 0, i.e., a is in P. If a contains 
no positive rational numbers, then one of two possibilities must hold: 

(1) a contains all negative rational numbers; then a = 0. 

(2) there is some negative rational number x which is not in a; it can be 
assumed that x is not the least element of Q, — a (since x could be 
replaced by x/2 > x); then —a contains the positive rational number 
— x, so, as we have just proved, — a is in P. 

This shows that at least one of (i)-(iii) must hold. If a = 0, it is clearly impossi- 
ble for condition (ii) or (iii) to hold. Moreover, it is impossible that a > 0 and 
—a > 0 both hold, since this would imply that 0 = a + (—a) > 0. | 

Recall that a > 0 was defined to mean that a contains but is unequal to 
/5. This definition was fine for proving completeness, but now we have to show 
that it is equivalent to the definition which would be made in terms of P. 
Thus, we must show that a — 0 > 0 is equivalent to a > 0. This is clearly a 
consequence of the next theorem. 

theorem If a, ft and y are real numbers and a > /3, then a + y > 0 + 7- 

PROOF The hypothesis a > 0 implies that 0 is contained in a; it follows immediately 
from the definition of + that /3 + y is contained in a + y. This shows that 
a + y > + y. We can easily rule out the possibility of equality, for if 

« + 7 = 0 + 7, 

then 

a = (a + 7) + (-7) = (0 + 7) + ("7) = ft 
which is false. Thus a + y > /3 + y. | 



Multiplication presents difficulties of its own. If a, £ > 0, then a • 0 can 
be defined as follows. 
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Definition. If a and 0 are real numbers and a, 0 > 0, then 
a • j8 = {z: z < 0 or 2: = * • j for some xina and y in 0 with x, > 0 } . 
THEOREM If a and 0 are real numbers with a, 0 > 0, then a • 0 is a real number. 

PROOF As usual, we much check four conditions. 

(1) Suppose w < z, where z is in a • 0. If u> < 0, then ze; is automatically 
in a • 0. Suppose that a; > 0. Then z > 0, so z = x • j> for some posi- 
tive x in a and positive ^ in 0. Now 



z z \z ) 



Since 0 < a; < z, we have zt>/z < 1, so (w/z) x is in a. Thus u> is 
in a • 0. 

(2) Clearly a • 0 ^ 0. 

(3) If * is not in a, and is not in 0, then x > *' for all *' in a, and 
j > y' for all / in 0. Hence ^ > for all such positive *' and /. 
So is not in a * ft thus a • j3 5^ Q,. 

(4) Suppose w is in a • ft and w < 0. There is some * in a with x > 0 
and some in £ with y > 0. Then z = xy is in a • 0 and z > 
Now suppose zt> > 0. Then w = xy for some positive x in a and some 
positive y in ft Moreover, a contains some x r > x; if z = x'.y, then 
z > xy = and z is in a • ft Thus a • 0 does not have a greatest 
element. | 

Notice that a • j8 is clearly in P if a and 0 are. This completes the verifica- 
tion of all properties of P. To complete the definition of • we first define \a\. 



Definition. If a is a real number, then 

\a\ = 



if a >0 
a, if a < 0. 



Definition. If a and 0 are real numbers, then 



0, if a = 0 or 0 = 0 

|a| - if a > 0, 0 > 0 or a < 0, 0 < 0 

k -(|a| • I0|), if a > 0, 0 < 0 or a < 0, 0 > 0. 



As one might suspect, the proofs of the properties of multiplication usually 
involve reduction to the case of positive numbers. 



THEOREM If or, 0, and 7 are real numbers, then a • (0 • 7) = (a • 0) • 7- 
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PROOF This is clear if a, 0, 7 > 0. The proof for the general case requires considering 
separate cases (and is simplified slightly if one uses the following theorem). | 

THEOREM If a and (3 are real numbers, then a • /3 = 0 • a. 

PROOF This is clear if a, 0 > 0, and the other cases are easily checked. | 

Definition. 1 = {x in Q: x < 1 } . 

(It is clear that 1 is a real number.) 

THEOREM If a is a real number, then a • 1 = a. 

PROOF Let a > 0. It is easy to see that every member of a • 1 is also a member of a. 

On the other hand, suppose x is in a. If x < 0, then x is automatically in 
a • 1. If x > 0, then there is some rational number y in a such that x < y. 
Then x = y • (x/y), and #/y is in 1, so * is in a • 1. This proves that a • 1 = a 
ifa>0. 

If a < 0, then, applying the result just proved, we have 

a-1 = -(|a|-|l|) = -(H) - a. 
Finally, the theorem is obvious when a = 0. | 

Definition. If a is a real number and a > 0, then 

a- 1 = { x in Q: x < 0, or x > 0 and 1/* is not in a, but 1/x is not the smallest 
member of Q, — a } ; 

if a < 0, then a" 1 = — (M" 1 ). 
THEOREM If a is a real number unequal to 0, then a" 1 is a real number. 

PROOF Clearly it suffices to consider only a > 0. Four conditions must be checked. 

(1) Suppose y < x, and x is in a" 1 . If y < 0, then y is in a -1 . If j > 0, 
then x > 0, so 1/* is not in a. Since 1/jy > 1/x, it follows that 1 /jy is 
not in a, and 1 /jy is clearly not the smallest element of Q, — a, so y is 



in a 



-1 



(2) Clearly a" 1 ^ 0. 

(3) Since a > 0, there is some positive rational number x in a. Then l/# 



is not in a \ so a" 



(4) Suppose x is in a" 1 . If x < 0, there is clearly some y in a:"" 1 with 
y > x because a -1 contains some positive rationals. If x > 0, then 
1 /x is not in a. Since 1 /x is not the smallest member of Q, — a, there 
is a rational number jy not in a, with y < 1/x. Choose a rational 
number ^ with y < z < 1/x. Then 1/z is in a, and 1/z > *. Thus 
a -1 does not contain a largest member. | 
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In order to prove that a" 1 is really the multiplicative inverse of a, it helps 
to have another lemma, which is the multiplicative analogue of our first 
lemma. 

LEMMA Let a be a real number with a > 0, and z a rational number with z > 1. 

Then there are rational numbers x in a, and y not in a, such that y/x = z. 
Moreover, we can assume that y is not the least element of Q — a. 

PROOF Suppose first that z is in a. Since z — 1 > 0 and 

*»=(! + (*- l)) n > 1 + n(z - 1), 
it follows that the numbers 

z, z 2 , z\ . . . 

cannot all be in a. So there is some k such that x = z h is in a, and ^ = 

is not in a. Clearly y /x = z. Moreover, if y happens to be the least element of 

Q, - a, let x' > x be an element of a, and replace x by x' and j byyx'/x. 

If z is not in a, there is a similar proof, based on the fact that the numbers 
l/z k cannot all fail to be in a. | 

THEOREM If a is a real number and a ^ 0, then a • a" 1 = 1. 

PROOF It obviously suffices to consider only a > 0, in which case a -1 > 0. Suppose 
that x is a positive rational number in a, and ^ is a positive rational number 
in or 1 . Then \/y is not in a, so \/y > x; consequently xy < 1, which means 
that xy is in 1. Since all rational numbers x < 0 are also in 1, this shows that 
every member of a • a"" 1 is in 1. 

To prove the converse assertion, let z be in 1. If z < 0, then clearly z is in 
a • or 1 . Suppose 0 < z < 1 . According to the lemma, there are positive 
rational numbers x in a, and y not in a, such that y/x = \/z\ and we can 
assume that y is not the smallest element of Q, — a. But this means that 
z = x • where * is in a, and l/> is in or 1 . Consequently, z is in a • a" 1 . | 

We are almost done ! Only the proof of the distributive law remains. Once 
again we must consider many cases, but do not despair. The case when all 
numbers are positive contains an interesting point, and the other cases can 
all be taken care of very neatly. 

theorem If a, 0, and y are real numbers, then a • (/3 + y) = a • & + a • y. 

PROOF Assume first that a, ft y > 0. Then both numbers in the equation contain 
all rational numbers < 0. A positive rational number in a • (/? + 7) is of 
the form x ■ (y + z) for positive x in a, y in 0, and z in 7. Since x ■ (y + z) = 
* • + * • z, where * • y is a positive element of a • 0, and x • z is a positive 
element of a • 7, this number is also in a • 0 + a • 7- Thus, every element of 
a • 03 + 7) is also in a • 0 + a • 7. 



On the other hand, a positive rational number in a • j8 + a ■ 7 is of the 
form xi - y + x 2 ' z for positive #i 5 * 2 in a, y in ft and z in 7. If x x < x 2 , then 
(*i/*0 ' y < y, so (*i/* 2 ) -jV is in ft Thus 

xi - y + x 2 * z = x 2 [(xi/x 2 )y + z] 

is in a • (/3 + 7). Of course, the same trick works if # 2 < xi. 

To complete the proof it is necessary to consider the cases whema, ft and 7 
are not all > 0. If any one of the three equals 0, the proof is easy and the cases 
involving a < 0 can be derived immediately once all the possibilities for 0 
and 7 have been accounted for. Thus we assume a > 0 and consider three 
cases: ft 7 < 0, and 0 < 0, 7 > 0, and 0 > 0, 7 < 0. The first follows 
immediately from the case already proved, and the third follows from the 
second by interchanging (3 and 7. Therefore we concentrate on the case 
0 < 0, 7 > 0. There are then two possibilities: 

(1) 0 + 7 >0. Then 

a • 7 = « • (W + 7] + = « ' 08 + 7) + « • 101, 

so 

«. 03 + 7) = -(a- |/3|) + a -7 
= a * (3 + a • 7. 

(2) 0 + 7 < 0. Then 

a • 101 = « • (10 + 7l + 7) = ol • |0 + 7I + <* • 7, 

so 

a • (0 + 7) = -(« • 10 + 7l) = -(a ■ 101) + a- 7 = <*-0 + <*'7.| 

This proof completes the work of the chapter. Although long and frequently 
tedious, this chapter contains results sufficiently important to be read in detail 
at least once (and preferably not more than once !). For the first time we know 
that we have not been operating in a vacuum — there is indeed a complete 
ordered field, the theorems of this book are not based on assumptions which 
can never be realized. One interesting and horrid possibility remains: there 
may be several complete ordered fields. If this is true, then the theorems of 
calculus are unexpectedly rich in content, but the properties P1-P13 are 
disappointingly incomplete. The last chapter disposes of this possibility; 
properties PI -PI 3 completely characterize the real numbers — anything that 
can be proved about real numbers can be proved on the basis of these proper- 
ties alone. 

PROBLEMS 

There are only two problems in this set, but each asks for an entirely different 
construction of the real numbers ! The detailed examination of another con- 
struction is recommended only for masochists, but the main idea behind these 
other constructions is worth knowing. The real numbers constructed in this 
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chapter might be called "the algebraist's real numbers," since they were 
purposely defined so as to guarantee the least upper bound property, which 
involves the ordering <, an algebraic notion. The real number system con- 
structed in the next problem might be called "the analyst's real numbers," 
since they are devised so that Cauchy sequences will always converge. 

1. Since every real number ought to be the limit of some Cauchy sequence 
of rational numbers, we might try to define a. real number to be a Cauchy 
sequence of rational numbers. Since two Cauchy sequences might con- 
verge to the same real number, however, this proposal requires some 
modifications. 

(a) Define two Cauchy sequences of rational numbers { a n } and { b n } to be 
equivalent (denoted by {a n } ~ {b n }) if lim (a n - b n ) = 0. Prove that 



\a n ) ~ {a n }, that [a n ] ~ {b n } if {b n } ~ {a n }, and that {a n } ~ {c n } 
if {a n \ ~ {b n } and {b n \ ~ [c n \. 

(b) Suppose that a is the set of all sequences equivalent to {a n }, and /3 is 
the set of all sequences equivalent to { b n } . Prove that either a Pi /3 = 0 
or a = 13. (If a C\ 0 ^ 0, then there is some [c n \ in both a and 0. Show 
that in this case a and /8 both consist precisely of those sequences 
equivalent to {c n }.) 

Part (b) shows that the collection of all Cauchy sequences can be split 
up into disjoint sets, each set consisting of all sequences equivalent to 
some fixed sequence. We define a real number to be such a collection, 
and denote the set of all real numbers by R. 

(c) If a and /3 are real numbers, let \a n ) be a sequence in a, and {b n ) a 
sequence in 0. Define a + j3 to be the collection of all sequences 
equivalent to the sequence {a n + b n }. Show that {a n + b n \ is a 
Cauchy sequence and also show that this definition does not depend 
on the particular sequences \a n } and {£ n } chosen for a and fi. Check 
also that the analogous definition of multiplication is well defined. 

(d) Show that R is a field with these operations; existence of a multiplica- 
tive inverse is the only interesting point to check. 

(e) Define the positive real numbers P so that R will be an ordered field. 

(f) Prove that every Cauchy sequence of real numbers converges. 
Remember that if { a n } is a sequence of real numbers, then each a n is 
itself a collection of Cauchy sequences of rational numbers. 

2. This problem outlines a construction of "the high-school student's real 
numbers." We define a real number to be a pair (a, {b n }), where a is an 
integer and \b n ] is a sequence of natural numbers from 0 to 9, with the 
proviso that the sequence is not eventually 9; intuitively, this pair repre- 



sents a + ) b n \0~ n . With this definition, a real number is a very con- 



crete object, but the difficulties involved in defining addition and multi- 




plication are formidable (how do you add infinite decimals without 
worrying about carrying digits infinitely far out?). A reasonable approach 
is outlined below; the trick is to use least upper bounds right from the 
start. 

(a) Define (a, {b n }) < (c, {d n }) if a < c, or if a = c and for some n we 
have b n < d n but b s = d 3 - for 1 < j < n. Using this definition, prove 
the least upper bound property. 

k 

(b) Given a = (a, {£„}), define a k = a + £ £ n lCT n ; intuitively, a k is 

n = 1 

the rational number obtained by changing all decimal places after 
the kth to 0. Conversely, given a rational number r of the form 

a + ^ ^ nl0 ~ n > let r ' denote th e real number (a, {b n f }), where 

n - 1 

b n r = 6 n for 1 < « < A and £ n ' = 0 for « > Now for a = (a, {b n }) 
and j8 = (c, \d n \) define 

a + 0 = sup {(a* + &)': A a natural number} 

(the least upper bound exists by part (a)). If multiplication is defined 
similarly, then the verification of all conditions for a field is a straight- 
forward task, not highly recommended. Once more, however, 
existence of multiplicative inverses will be the hardest. 



CHAPTER ^ UNIQUENESS OF THE REAL NUMBERS 



We shall now revert to the usual notation for real numbers, reserving boldface 
symbols for other fields which may turn up. Moreover, we will regard integers 
and rational numbers as special kinds of real numbers, and forget about the 
specific way in which real numbers were defined. In this chapter we are 
interested in only one question: are there any complete ordered fields other 
than R? The answer to this question, if taken literally, is "yes." For example, 
the field F z introduced in Chapter 25 is a complete ordered field, and it is cer- 
tainly not R. This field is a "silly 5 ' example because the pair {a, a) can be 
regarded as just another name for the real number a; the operations 

(a, a) + (A, b) = {a + b, a + b), 
(a, a) • (6, b) « (a • b 9 a • b)> 

are consistent with this renaming. This sort of example shows that any 
intelligent consideration of the question requires some mathematical means 
of discussing such renaming procedures. 

If the elements of a field F are going to be used to rename elements of R, 
then for each a in R there should correspond a "name" f(a) in F. The notation 
f(a) suggests that renaming can be formulated in terms of functions. In order 
to do this we will need a concept of function much more general than any 
which has occurred until now; in fact, we will require the most general notion 
of "function" used in mathematics. A function, in this general sense, is simply 
a rule which assigns to some things, other things. To be formal, a function is a 
collection of ordered pairs (of objects of any sort) which does not contain two 
distinct pairs with the same first element. The domain of a function / is the 
set A of all objects a such that (a, b) is in /for some b; this (unique) b is denoted 
by /(a). Iff (a) is in the set B for all a in A, then / is called a function from A 
to B. For example, 

if f(x) = sin x for all x in R (and / is defined only for x in R), then / is a 
function from R to R; it is also a function from R to [— 1, 1]; 

if f( z ) = s in z for all z in C, then / is a function from C to C; 

if f(z) = e z for all z in C, then / is a function from C to C; it is also a func- 
tion from C to \z in C: z ?± 0}; 

6 is a function from \z in C: z ^ 0} to {x in R: 0 < x < 2t}; 

if / is the collection of all pairs (a, (a, a)) for a in R, then / is a function 
from R to F 3 . 
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Suppose that F\ and F 2 are two fields; we will denote the operations in Fi 
by ©j O, etc. and the operations in F 2 by +, •, etc. If F 2 is going to be con- 
sidered as a collection of new names for elements of F u then there should be a 
function from Fi to F 2 with the following properties: 

(1) The function / should be one-one, that is, if x ^ y, then we should 
have fix) ^ f(y); this means that no two elements of F x have the 
same name. 

(2) The function / should be "onto," that is, for every element z in F 2 
there should be some x in Fi such that z = f(x) ; this means that every 
element of F 2 is used to name some element of Fi. 

(3) For all x and y in Fi we should have 

f(x (By) =f( x )+fiy), 
fixOy) =fix)-f(y}; 

this means that the renaming procedure is consistent with the opera- 
tions of the field. 

If we are also considering Fi and F 2 as ordered fields, we add one more 
requirement: 

(4) lfx©y } then /(*)</(>). 

A function with these properties is called an isomorphism from Fi to F 2 . 
This definition is so important that we restate it formally. 



DEFINITION 



If Fx and F 2 are two fields, an isomorphism from Fi to F 2 is a function / 
from Fi to F 2 with the following properties: 

(1) Ux^y, then fix) * f(y). 

(2) If z is in F 2) then z = fix) for some x in Fi. 

(3) If x and y are in Fi, then 

f(x®y) =f( x )+f(y), 
f(xOy) =f(x)-f(y). 

If Fx and F 2 are ordered fields we also require : 

(4) If x €> y, then /(*) < fiy). 



The fields Fi and F 2 are called isomorphic if there is an isomorphism 
between them. Isomorphic fields may be regarded as essentially the same — any 
important property of one will automatically hold for the other. Therefore, 
we can, and should, reformulate the question asked at the beginning of the 
chapter; if F is a complete ordered field it is silly to expect F to equal R — 
rather, we would like to know if Fis isomorphic to R. In the following theorem, 
F will be a field, with operations + and and "positive elements" P; we 
write a < b to mean that b — a is in P, and so forth. 
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THEOREM If F is a complete ordered field, then F is isomorphic to R. 

PROOF Since two fields are defined to be isomorphic if there is an isomorphism 
between them, we must actually construct a function /from R to F which is an 
isomorphism. We begin by defining / on the integers as follows: 

M = 0, 

f(n) = 1 + • • • + 1 for n > 0, 

n times 

f(n) = -(1 + • • • + 1) for n < 0. 

jn| times 

It is easy to check that 

f(m + n) = f(m) + f(n), 
f(m-n) = f(m)-f(n), 

for all integers m and n, and it is convenient to denote /(n) by n. We then 
define / on the rational numbers by 

f(m/n) = m/n = m • n" 1 

(notice that 1+ • • • +1^0ifn>0, since F is an ordered field). This 
definition makes sense because if m/n = k/l, then ml = nk 9 so m • I = fc • n, 
so m • n" 1 = ft • t" 1 . It is easy to check that 

f(n + u) = fin) + /(r 2 ), 
/(ri ' n) = /(ri) • /(n), 

for all rational numbers ri and r 2 , and that /(ri) < /(r 2 ) if ri < r 2 . 

The definition of /W for arbitrary x is based on the now familiar idea that 
any real number is determined by the rational numbers less than it. For any 
x in R, let A x be the subset of F consisting of all f(r), for all rational numbers 
r < x. The set A x is certainly not empty, and it is also bounded above, for if 
r 0 is a rational number with r 0 > x, then/(r 0 ) >/(r) for all/(r) in A x . Since F 
is a complete ordered field, the set A x has a least upper bound; we define /(*) 
as sup A x . 

We now have /(*) defined in two different ways, first for rational x, and 
then for any x. Before proceeding further, it is necessary to show that these two 
definitions agree for rational x. In other words, if x is a rational number, we 
want to show that 

sup A x = f{x), 

where /(x) here denotes m/n, for x = m/n. This is not automatic, but depends 
on the completeness of F; a slight digression is thus required. 
Since F is complete, the elements 



1 + 



+ 1 for natural numbers n 



n times 



form a set which is not bounded above; the proof is exactly the same as the 
proof for R (Theorem 8-2). The consequences of this fact for R have exact 
analogues in F: in particular, if a and b are elements of F with a < b y then 
there is a rational number r such that 

a < /(r) < b. 

Having made this observation, we return to the proof that the two definitions 
of f(x) agree for rational x. If y is a rational number with y < x, then we have 
already seen that f(y) < f(x). Thus every element of A x is < f(x). Consequently, 

sup A x < f(x). 
On the other hand, suppose that we had 

sup A x < f(x). 

Then there would be a rational number r such that 

sup A x <f(r) </(*). 

But the condition /(r) < /(*) means that r < x, which means that f(r) is in the 
set A x \ this clearly contradicts the condition sup A x < f{r). This shows that 
the original assumption is false, so 

sup A x = /(*). 

We thus have a certain well-defined function / from R to F. In order to 
show that / is an isomorphism we must verify conditions (l)-(4) of the defini- 
tion. We will begin with (4). 

If x and y are real numbers with x < y, then clearly A x is contained in A y . 
Thus 

/(*) = sup A x < sup A v = f(y). 

To rule out the possibility of equality, notice that there are rational numbers 
r and s with 

x < r < s < y. 
We know that f(r) < f(s). It follows that 

/w</w</w</w. 

This proves (4). 

Condition (1) follows immediately from (4): If x ^ y, then either x < y 
or y < x; in the first case /(*) < f(y), and in the second case f(y) </(*); in 
either case /(*) ^ f(y). 

To prove (2), let a be an element of F, and let B be the set of all rational 
numbers r with f{r) < a. The set B is not empty, and it is also bounded above, 
because there is a rational number s with f(s) > a, so that/(j) >/(r) for r in 
B, which implies that s > r. Let x be the least upper bound of B; we claim 
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that f(x) = a. In order to prove this it suffices to eliminate the alternatives 

/(*) < <h 
«</(*). 

In the first case there would be a rational number r with 

/(*) < f(r) < a. 

But this means that x < r and that r is in B, which contradicts the fact that 
x = sup B. In the second case there would be a rational number r with 

a < fir) < fix). 

This implies that r < x. Since x = sup B, this means that r < s for some j in 2?. 
Hence 

fir) <fis)<a, 

again a contradiction. Thus f(x) = a, proving (2). 

To check (3), let x and y be real numbers and suppose that fix + y) 5* 

/(*) + fiy)- Then either 

/(* + y)< /« + /GO or /(*) + /GO < /(* + y). 
In the first case there would be a rational number r such that 

fr. + y) <m </(*)+/W- 

But this would mean that 

^ + > < r. 

Therefore r could be written as the sum of two rational numbers 

r = ri + r 2 , where x < ti and < r 2 . 
Then, using the facts checked about /for rational numbers, it would follow that 

f(r) = fin + n) = /(ri) +/(ri) > /(*) +/W, 

a contradiction. The other case is handled similarly. 

Finally, if a: and^ are positive real numbers, the same sort of reasoning shows 
that 

/<*-j0 -/W-/W; 

the general case is then a simple consequence. | 

This theorem brings to an end our investigation of the real numbers, and 
resolves any doubts about them: There is a complete ordered field and, up to 
isomorphism, only one complete ordered field. It is an important part 
of a mathematical education to follow a construction of the real numbers in 
detail, but it is not necessary to refer ever again to this particular construction. 
It is utterly irrelevant that a real number happens to be a collection of rational 
numbers, and such a fact should never enter the proof of any important 



theorem about the real numbers. Reasonable proofs should use only the fact 
that the real numbers are a complete ordered field, because this property of 
the real numbers characterize them up to isomorphism, and any significant 
mathematical property of the real numbers will be true for all isomorphic 
fields. To be candid I should admit that this last assertion is just a prejudice 
of the author, but it is one shared by almost all other mathematicians. 

PROBLEMS 

1. Let / be an isomorphism from Fx to F 2 . 

(a) Show that /(0) = 0 and /(I) = 1. (Here 0 and 1 on the left denote 
elements in Fx, while 0 and 1 on the right denote elements of F 2 .) 

(b) Show that /(-a) = -/(a) and /(a- 1 ) = f(a)~\ for a * 0. 

2. Here is an opportunity to convince yourself that any significant property 
of a field is shared by any field isomorphic to it. The point of this problem 
is to write out very formal proofs until you are certain that all statements 
of this sort are obvious. Fi and F 2 will be two fields which are isomorphic; 
for simplicity we will denote the operations in both by + and •. Show that: 

(a) If the equation x 2 + 1 = 0 has a solution in F h then it has a solution 
in F 2 . 

(b) If every polynomial equation x n + <z n __i • x n ~ l + • • • + a 0 — 0 
with a 0y . . . , <2 n _ x in Fi has a root in F u then every polynomial 
equation x n + b n ^x • x n ~ l + • • • + b 0 — 0 with b 0 , . . . , in 
F 2 has a root in F 2 . 

(c) If 1 + * * • +1 (summed m times) = 0 in F ly then the same is true 
in F 2 . 

(d) If F x and F 2 are ordered fields (and the isomorphism / satisfies 
/(*) < fiy) f° r x < y) an d Fi is complete, then F 2 is complete. 

3. Let / be an isomorphism from Fx to F 2 and g an isomorphism from F 2 to 
F z . Define the function g of from Fi to F 3 by (g © /)(#) = g(f(x)). Show 
that g o / is an isomorphism. 

4. Suppose that Fis a complete ordered field, so that there is an isomorphism 
/ from R to F. Show that there is actually only one isomorphism from R 
to F. Hint: In case F = R, this is Problem 3-17. Now if / and g are two 
isomorphisms from R to F consider g~ l ° f. 

5. Find an isomorphism from C to C other than the identity function. 



SUGGESTED 
READING 

A man ought to read 
just as inclination leads him; 
for what he reads as a task 
will do him little good. 

SAMUEL JOHNSON 



One purpose of this bibliography is to guide the reader to other 
sources, but the most important function it can serve is to indicate the variety 
of mathematical reading available. Consequently, there is an attempt to 
achieve diversity, but no pretense of being complete. The present plethora of 
mathematics books would make such an undertaking almost hopeless in any 
case, and since I have tried to encourage independent reading, the more 
standard a text, the less likely it is to appear here. In some cases, this philos- 
ophy may seem to have been carried to extremes, as some entries in the list 
cannot be read by a student just finishing a first course of calculus until several 
years have elapsed. Nevertheless, there are many selections which can be read 
now, and I can't believe that it hurts to have some idea of what lies ahead. 

One of the most elementary unproved theorems mentioned in this book is 
the fact that every natural number can be written as a product of primes in 
only one way. A proof of this basic theorem will be found near the beginning of 
almost any book on elementary number theory. Few books have won so 
enthusiastic an audience as 

[1] An Introduction to the Theory of Numbers (third edition), by G. H. Hardy 
and E. M. Wright; Clarendon Press, Oxford, 1960. 

The Pergamon Press publishes a series, Popular Lectures in Mathematics, 
with several worthwhile titles, among them 

[2] A Selection of Problems in the Theory of Numbers, by W. Sierpinski; Mac- 
millan (Pergamon), New York, 1964. 

Finally, I will mention a little book which I hope is still in print: 

[3] Three Pearls of Number Theory, by A. Khinchin; Graylock Press, 
Rochester, N.Y., 1952. 

The subject of irrational numbers straddles the fields of number theory and 
analysis. An excellent introduction will be found in 

[4] Irrational Numbers, by I. M. Niven; Wiley, New York, 1956. 

Together with many historical notes, there are references to some fairly 
elementary articles in journals. There is also a proof that ir is transcendental 
(see also [53]) and, finally, a proof of the "Gelfond-Schneider theorem": 
If a and b are algebraic, with a ^ 0 or 1, and b is irrational, then a h is 
transcendental . 

All the books listed so far begin witn natural numbers, but whenever neces- 
sary take for granted the irrational numbers, not to mention the integers and 
rational numbers. Several recent books present a construction of the rational 
numbers from the natural numbers, but it is hard to believe that there can 
be a more lucid treatment than the one to be found in 

[5] Foundations of Analysis, by E. Landau; Chelsea, New York, 1951. 

Incidentally, the original German edition, 

[6] Grundlagen der Analysis (fourth edition), by E. Landau; Chelsea, New 
York, 1965. 

is now available in paper back, together with a complete German-English 
dictionary (of about 300 words) for the whole book — an excellent way to begin 



reading mathematical German. The basic idea for constructing the real 
numbers is derived from Dedekind, whose contributions can be found in 

[7] Essays on the Theory of Numbers, by R. Dedekind; Dover, New York, 
1963. 

While many mathematicians are content to accept the natural numbers 
as a natural starting point, numbers can be defined in terms of sets, the most 
basic starting point of all. A charming exposition of set theory can be 
found in a sophisticated little book called 

[8] Naive Set Theory, by P. R. Halmos; Van Nostrand, Princeton, N.J., 
1961. 

Another very good introduction is 

[9] Theory of Sets, by E. Kamke; Dover, New York, 1950. 

Perhaps it is necessary to assure some victims of the "new math" that set 
theory does have some mathematical content (in fact, some very deep 
theorems). Using these deep results, Kamke proves that there is a discon- 
tinuous function / such that f(x + y) = /(*) + f(y) for all x and y. For those 
who enjoy reading the classics, the most important notions of set theory were 
first introduced by Cantor, whose work is reproduced in 

[10] Contributions to the Founding of the Theory of Transfinite Numbers, by G. 
Cantor; Dover, New York, 1952. 

Inequalities, which were treated as an elementary topic in Chapters 1 and 2, 
actually form a specialized field. A good elementary introduction is provided 
by 

[11] Analytic Inequalities, by N. Kazarinoff; Holt, Rinehart and Winston, 
New York, 1961. 

Twelve different proofs that the geometric mean is less than or equal to the 
arithmetic mean, each based on a different principle, can be found in the 
beginning of the more advanced book 

[12] Inequalities, by E. Beckenbach and R. Bellman; Springer, New York, 
1961. 

The classic work on inequalities is 

[13] Inequalities (second edition), by G. H. Hardy, J. E. Littlewood, and 
G. Polya; Cambridge University Press, New York, 1952. 

Each of the authors of this triple collaboration has provided his own con- 
tribution to the sparse literature about the nature of mathematical thinking, 
written from a mathematician's point of view. My favorite is 

[14] A Mathematician's Apology, by G. H. Hardy; Cambridge University 
Press, New York, 1940. 
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Littlewood's anecdotal selections are entitled 

[15] A Mathematician's Miscellany, by J. E. Littlewood; Methuen, 1953. 

Polya's contribution is pedagogy at the highest level: 

[16] Mathematics and Plausible Reasoning, by G. Polya (Vol. I: Induction and 
Analogy in Mathematics; Vol. II: Patterns of Plausible Inference); Princeton 
University Press, Princeton, N.J., 1954. 

Geometry is the other main field which can be considered as background 
for calculus. Euclid's Elements is still a masterful mathematical work, but 
should perhaps be postponed until some preparation has been made. Probably 
the best modern work on "classical geometry" is 

[17] Elementary Geometry from an Advanced Standpoint, by E. Moise; Addison- 
Wesley, Reading, Mass., 1963. 

This beautiful book provides excellent historical perspectives and contains a 
thorough discussion of the role of the "Archimedean axiom" in geometry; in 
addition, Chapter 28 describes an ordered field in which the Archimedean 
axiom does not hold. Speaking of beautiful geometry books, all sorts of 
fascinating things can be found in 

[18] Introduction to Geometry, by H. S. Coxeter; Wiley, New York, 1961. 

Almost all treatments of geometry at least mention convexity, which forms 
another specialized topic. I cannot imagine a better introduction to convexity, 
or a better mathematical experience in general, than reading and working 
through 

[19] Convex Figures, by I. M. Yaglom and W. G. Boltyanskii; Holt, Rinehart 
and Winston, New York, 1961. 

This book contains a carefully arranged sequence of definitions and statements 
of theorems, whose proofs are to be supplied by the reader (worked-out proofs 
are supplied in the back of the book). Another geometry book has been 
modeled on the same principle: 

[20] Combinatorial Geometry in the Plane, by H. Hadwiger and H. Debrunner; 
Holt, Rinehart and Winston, New York, 1964. 

Along with these two out-of-the-ordinary books, I might mention an extremely 
valuable little book, also of a specialized sort, 

[21] Counterexamples in Analysis, by B. Gelbaum and J. Olmsted; Holden- 
Day, San Francisco, 1964. 

Many of the examples in this book come from more advanced topics in 
analysis, but quite a few can be appreciated by someone who knows calculus. 



Of calculus books I will mention only two, each something of a classic: 

[22] A Course of Pure Mathematics (tenth edition), by G. H. Hardy; Cam- 
bridge University Press, New York, 1952. 

[23] Differential and Integral Calculus, by R. Courant; Vol. I, second edition, 
1937; Vol. II, first edition, Wiley (Interscience), New York, 1936. 

Courant is especially strong on applications. In addition, the latter parts of 
Volume I contain material usually found in advanced calculus, including 
differential equations and Fourier series. An introduction to Fourier series 
(requiring a little advanced calculus) will also be found in 

[24] An Introduction to Fourier Series and Integrals, by R. Seeley; W. A. Ben- 
jamin, New York, 1966. 

The second volume of Courant (advanced calculus in earnest) contains addi- 
tional material on differential equations, as well as an introduction to the 
calculus of variations. I will not mention any books devoted solely to the 
calculus of variations, since they are (of necessity) quite difficult. Innumerable 
books on differential equations have been written, but none of the elementary 
ones seems to generate much enthusiasm. There is a somewhat more advanced 
book, however, which is universally admired: 

[25] Lectures on Ordinary Differential Equations, by W. Hurewicz; M.I.T. 
Press, Cambridge, Mass., 1958. 

I will bypass the more or less standard advanced calculus books (which can 
easily be found by the reader himself) since nowadays there is a move- 
ment to revise the whole presentation of advanced calculus, basing it upon 
linear algebra. One of the first, and still one of the nicest, treatments of 
advanced calculus using linear algebra is 

[26] Calculus of Vector Functions, by R. H. Crowell and R. E. Williamson; 
Prentice-Hall, Englewood Cliffs, N.J., 1962. 

Several recent books on advanced calculus attempt to acquaint under- 
graduates with very large areas of modern mathematics. My favorite, of 
course, is 

[27] Calculus on Manifolds, by M. Spivak; W. A. Benjamin, New York, 1965. 

There are three other topics which are somewhat out of place in this 
bibliography because they are rapidly becoming established as part of a 
standard undergraduate curriculum. The purposeful study of fields and 
related systems is the domain of "algebra." The first undergraduate text on 
modern algebra was 

[28] A Survey of Modern Algebra (third edition), by G. BirkhofT and S. 
MacLane; Macmillan, New York, 1941. 
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One of the strongest competitors is now 

[29] Topics in Algebra, by I. N. Herstein; Ginn (Blaisdell), Boston, Mass., 



Herstein's book is meant to be intermediate in difficulty between A Survey 
of Modern Algebra and one of the great classics: 

[30] Modern Algebra, by B. L. van der Waerden; Ungar, New York, 1953. 

By the way, this book contains a proof of the partial fraction decomposition 
of a rational function. 

One of the standard texts in complex analysis is 

[31] Complex Analysis (second edition), by L. V. Ahlfors; McGraw-Hill, 
New York, 1966. 

I am personally looking forward to the publication of 

[32] Lectures on the Theory of Functions of a Complex Variable, by G. W. Mackey ; 
Van Nostrand, Princeton, N.J., 1967. 

Finally, the study of topology, although never mentioned before, has really 
been in the background of many discussions, since it is the natural generaliza- 
tion of the ideas about limits and continuity which play such a prominent role 
in Part II of this book. There are now many elementary books on topology, 
but I am dismayed by the prospect of reading and evaluating them all, so I 
will merely call attention to the fact that they exist, and warn that some are 
not very good. 

The next few topics, ranging from elementary to very difficult, are included 
in this bibliography because they have been alluded to in the text. The proof 
that a nondecreasing function is differentiable at almost all points (and an 
explanation of just what this means) receives a beautiful exposition in 

[33] Functional Analysis, by F. Riesz and B. Sz.-Nagy; Ungar, New York, 



(After this elementary beginning, the book moves on to quite advanced 
material.) The gamma function has an elegant little book devoted entirely to 
its properties, most of them proved by using the theorem of Bohr and Mollerup 
which was mentioned in Problem 18-25: 

[34] The Gamma Function, by E. Artin; Holt, Rinehart and Winston, New 
York, 1964. 

The gamma function is only one of several important improper integrals in 
mathematics. In particular, the calculation^ jj e~ x% dx (see Problem 18-27) 
is important in probability theory, where the "normal distribution function" 



1963. 



1955. 




plays a fundamental role. The following book has already become something 

of a classic: 

[35] An Introduction to* Probability Theory and Its Applications (second edition), 
by W. Feller; Wiley, New York, 1957. 

The impossibility of integrating certain functions in elementary terms (among 
them f(x) = e~ x *) is one of the most esoteric subjects in mathematics. An 
interesting discussion of the possibilities of integrating in elementary terms, 
with an outline of the impossibility proofs, and references to the original 
papers of Liouville, will be found in 

[36] The Integration of Functions of a Single Variable (second edition), by 
G. H. Hardy; Cambridge University Press, New York, 1958. 

A complete presentation of the impossibility proofs will be found in 

[37] Integration in Finite Terms, by J. Ritt; Columbia University Press, New 
York, 1948. 

Oddly enough, a related but seemingly more difficult problem has a much 
neater solution. There are simple differential equations (y" + xy — 0 is a 
specific example) whose solutions cannot be expressed even in terms of 
indefinite integrals of elementary functions. This fact is proved on page 43 
of the (60-page) book: 

[38] An Introduction to Differential Algebra, by I. Kaplansky; Hermann, Paris, 
1957. 

To read this book you will need to know quite a bit of algebra, however. 
(Just recently, equally algebraic and polished treatments of Liouville's 
theorems have been obtained, and presumably they will be published 
soon.) 

A few words should also be said in defense of the process of integrating in 
elementary terms, which many mathematicians, look upon as an art (unlike 
differentiation, which is merely a skill). You are probably already aware that 
the process of integration can be expedited by tables of indefinite integrals. 
For those who enjoy perusing tables there is a really beautiful collection, that 
includes indefinite integrals, definite improper integrals, and a great deal 
more besides (if you should ever happen to need the value of the thirty-fourth 
Bernoulli number, this is the place to look) : 

[39] Tables of Integrals, Series, and Products, by I. S. Gradschteyn and I. W. 
Ryzhik; Academic Press, New York, 1965. 

For the thrifty, there is a paperback table of integrals: 

[40] Tables of Indefinite Integrals, by G. Petit Bois; Dover, New York, 1961. 
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The remaining references are of a somewhat different sort. They fall into 
three categories, of which the first is historical. The letter of H. A. Schwartz 
referred to in Problem 11-49 will be found in 

[41] Ways of Thought of Great Mathematicians, by H. Meschkowski; Holden- 
Day, San Francisco, 1964. 

Some historical remarks, and an attempt to incorporate them into the teaching 
of calculus, will be found in 

[42] The Calculus: A Genetic Approach, by O. Toeplitz; University of 
Chicago Press, Chicago, 111., 1963. 

Most textbooks on the history of mathematics are both superficial and dull. 
An admirable exception is 

[43] An Introduction to the History of Mathematics, by H. Eves; Holt, Rinehart 
and Winston, New York, 1964. 

Three good scholarly works are 

[44] History of Analytic Geometry, by C. Boyer; Academic Press, New York, 
' 1965, 

[45] A History of the Calculus, and Its Conceptual Development, by C. Boyer; 

Dover, New York, 1959. 
[46] The Mathematics of Great Amateurs, by J. Coolidge; Dover, New York, 

1963. 

A recent book presents philosophical ruminations on the history of mathe- 
matics by an author whose exceptional erudition is all the more impressive 
in a first-rate mathematician: 

[47] The Role of Mathematics in the Rise of Science, by S. Bochner; Princeton 
University Press, Princeton, N.J., 1966. 

Finally, extracts from original sources will be found in 

[48] A Source Book in Mathematics (2 vols.), by D. Smith; Dover, New York, 
1959. 

The large number of books listed here might easily give too hopeful a view of 
the availability of historical information. Although the very early origins of 
mathematics are receiving the most careful scrutiny, no one seems to care very 
much about the origins of calculus. For example, it is almost impossible to find 
out who first proved the Mean Value Theorem (according to the Encyhlopddie 
der Mathematischen Wissenschaften, Volume II, it was O. Bonnet, whose name 
is familiar to students of differential geometry from the ' 6 Gauss-Bonnet 
Theorem"). Similarly, nearly every history book tells us that Wallis proved 
Wallis's formula by a "complicated method of interpolation," but almost 
none bothers to mention what it was, even though it inspired Euler's investiga- 



tions of the gamma function (a description is given in the answer book, along 
with the solution to Problem 18-26). 

The second category in this final group of books might be described as 
"popularizations." The New York Times editorials notwithstanding, there are 
a surprisingly large number of first-rate ones by real mathematicians: 

[49] What is Mathematics? (fourth edition), by R. Courant and H. Robbins; 
Oxford University Press, New York, 1947. 

[50] Geometry and the Imagination, by D. Hilbert and S. Cohn-Vossen. 
Chelsea, New York, 1956. 

[51] The Enjoyment of Mathematics, by H. Rademacher and O. Toeplitz; 
Princeton University Press, Princeton, N.J., 1957. 

[52] Famous Problems of Mathematics (second edition), by H. Tietze; Gray- 
lock Press, Rochester, N.Y., 1965. 

One of the most renowned "popularizations" is especially concerned with the 
teaching of mathematics: 

[53] Elementary Mathematics from an Advanced Standpoint, by F. Klein (vol. 1 : 
Arithmetic, Algebra, Analysis; vol. 2: Geometry)', Dover, New York, 1948. 

Volume 1 contains a proof of the transcendence of x which, although not so 
elementary as the one in [4], is a direct analogue of the proof that e is trans- 
cendental, replacing integrals with complex line integrals. It can be read as 
soon as the basic facts about complex analysis are known. 

The third category is the very opposite extreme — original papers. The 
difficulties encountered here are formidable, and I have only had the courage 
to list one such paper, the source of the quotation for Part IV. It is not even 
in English, although you do have a choice of foreign languages. The article 
in the original French is in 

[54] Oeuvres Competes a" Abel; Christiania. Johnson Reprint Corporation, 
New York, 1965. 

It first appeared in a German translation in the Journal fiir die reine und 
angewandte Mathematik (1) 1826. To compound the difficulties, these references 
will usually be available only in university libraries. Yet the study of this 
paper will probably be as valuable as any other reading mentioned here. The 
reason is suggested by a remark of Abel himself, who attributed his profound 
knowledge of mathematics to the fact that he read the masters, rather than 
the pupils. 



ANSWERS 
TO SELECTED 
PROBLEMS 



CHAPTER 1 1. (i) 1 = a" 1 a = a' 1 (ax) = (a l a)x = 1 • x = x. 

(iii) If x 2 = .y 2 , then 0 = x 2 - j» - (* - jy) (* + y), so either a: - y = 0 
or x + y - 0, that is, either * = — ^ or x = j. 

(vi) Replace > by -jy in (iv). 

2. One step requires dividing by x — y = 0. 

3. (i) */* = ab-i = (ae)(b^e~ l ) = (ac)(bc)^ (by (iii)) = ac/bc. 

(ii) (flrf + fc)/(W) = (ad + bc){bd)- 1 = + bc)(b~^) (by (hi)) 
= a^r 1 + aT 1 = <z/4 + c/d. 

(iii) ^(a"^" 1 ) « (a • a" 1 ) (4 • r 1 ) - 1, so a- 1 • 6 » - («*) l - 
(v) (a lb) I (c/d) = (a/bKc/d)' 1 = (« * ^X* ' 1 

= ( fl • r l )(c -1 • <0 = * = fl<J W 1 
= M/(4<). 

4. (i) *<-l. 

(iii) * > Vl or a: < - V 7. 

(v) All *, since a: 2 - 2* + 2 = (* - l) 2 + 1. 

(vii) x > 3 or * < -2, since 3 and -2 are the roots of x 2 - x - 6 = 0. 
(ix) * > 7T or -5 < x < 3. 

(xi) x < 3. 

(xiii) x > 1 or 0 < x < 1. 

5. (i) & - « and - * are in P, so (4 - a) + (d - *) = (* + d) - 

(a + c) is in P. Thus, b + d > a + c. 
(iii) Using (ii), -c < -d; then (i) implies that a + (-*) < b + (-<*). 
(v) (b - fl ) and -c are in />, so -c(b - a ) = ac - be is in P, that is, 

ac > be. 

(vii) Using (iv), a > 0 and a < 1, so a 2 < a. 
(ix) Substitute a for <;_and 4 for d in (viii). 
9. (i) V2 + V3 - V5 + V7. 
(iii) |a + 4| +>| - |a + * + 
( V ) V2 + V3 + V5 - V7. 

10. (i) a if a > -4 and 4 > 0; 

— « if <z < —4 and b < 0; 
a + 2b if a > -4 and 4 < 0; 
-a - 24 if a < -4 and 4 > 0. 
(iii) x - x 2 if x > 0; 

-x - * 2 if * < 0. 

11. (i) x = 11, -5. 
(iii) -6 < x < -2. 

(v) No * (the distance from x to 1 plus the distance from x to - 1 is at 
least 2). 

(vii) x = 1, — 1. .1,1111 

12. (i) (M) 2 = M 2 = *V = WW = (W ' since M and 1*1 ' w 

are both > 0, this proves that |xy| = |*| • \y\. 
(iii) \x\/\y\ = \x\ ■ bl" 1 = |*| • Ir 1 ! (")) - I^T'I ( b y ®> = Ml- 
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(v) It follows from (iv) that |*| = \y — (y — x)\ < \y\ + \y — x\, so 

|*| - \y\ <\x- y\. 
(vii) \x +y + z\ < \x + y\ + \z\ < \x\ + \y\ + \z\. If equality holds, 

then \x + y\ = \x\ + [y|, so # and y have the same sign. Moreover, 

z must have the same sign as x + y, so x, y, and z must all have the 

same sign (unless one is 0). 



chapter 2 1. (i) Since l 2 = 1 • (2) • (2 • 1 + l)/6, the formula is true for « = 1. 

Suppose that the formula is true for k. Then 

i 2 + • • • + v + (k + \y = *(* + i)( 2 * + *) + {k + 1)2 

6 

= [k(2k + 1) + 6(* + 1)] 

6 

= (A±ll [{k + 2 )(2k + 3)] 
6 

_ (* + l)(* + 2)(2[* + 1] + 1) , 
6 

so the formula is true for k + 1. 

2. (0 



£ (2i - 1) = 1 + 3 + 5 + • • • + (2n - 1) 

• • • + 2n 
- n(n + 1) 



= 1 + 2 + 3 + • • • + 2n - 2(1 + • • • + n) 

_ (2n)(2n + 1) 



2 

= n\ 

4. (a) Since 



1 - r 2 

l+r = -> 

1 — r 

the formula is true for n = 1. Suppose that 

1 - r n+l 

1 + r + • • • + r n = ' 

\ — r 

Then 

1 — r n +l 

1 + r + * • • + r n + r n+1 = \- r n+l 

1 — r 

= 1 - r* +1 + r w+1 (l - 0 
1 - r 

= 1 - r w+1 
1 - r 
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(b) 



Thus 



so 



S = 1 + r + • • • + r n 
rS = r + • • • + r n + r n+1 . 

J(l - r) = J - rS = 1 - r* +1 , 



1 - r 
(i) From 

(* + l) 4 - k 4 = 4k 9 + 6k 2 + 4k + 1, k = 1, . . . , n 
we obtain 

n n n 

( n + 1)4 - 1 = 4 V A: 3 + 6 J P + 4 Y * + 
so 



n 



(B + 1) ,_ 1 - 6 "(" + ^ 2 " + ^-4^±i>- W 

6 2 



, « 3 , « 2 
= " — r — H -* 
4 2 4 

(iii) From 

1 1 1 



it k + \ k{h + 1) 
we obtain 



1 



n + 1 Li k{k + l) 

1 is either even or odd, in fact it is odd. Suppose n is either even or odd; 
then n can be written either as 2k or 2k + 1. In the first case n + 1 = 
2A; + 1 is odd; in the second case n + 1 = 2A; + 1 + 1 = 2{k + 1) is 
even. In either case, n + 1 is either even or odd. (Admittedly, this looks 
fishy, but it is really correct.) 

Let B be the set of all natural numbers / such that n 0 — 1 + / is in A. 
Then 1 is in B y and / + 1 is in B if / is in B, so B contains all natural 
numbers, which means that A contains all natural numbers > n 0 - 

(a) Yes, for if a + b were rational, then b = (a + b) - a would be 
rational. If a and b are irrational, then a + b could be rational, for b 
could be r — a for some rational number a. 

(b) If a = 0, then ab is rational. But if a * 0, then ab could not be 
rational, for then b = (ab) ■ a -1 would be rational. 



(c) Yes; for example, \^2. 

(d) Yes; for example, V2 and — V2. 
12. (a) Since 

(3„ + 1)2 = 9n 2 + 6n + x = 3( 3w 2 + 2w ) + l ? 

(3„ + 2) 2 = 9n 2 + Yin + 4 = 3(3rc 2 + 4rc + 1) + 1, 

it follows that \ik 2 is divisible by 3, then £ must also be divisible by 3. 
Now suppose that VI were rational, and let V3 = p/q where p and 
q have no common factor. Then p 2 = 3# 2 , so /> 2 is divisible by 3, so 
/? must be. Thus, p = 3p' for some natural number p\ and conse- 
quently (3/0 2 = 3? 2 , or 3(//) 2 = ? 2 - Thus, 9 is also divisible by 3, a 
contradiction. 

The same proofs work for and vi because the equations 

(5n + l) 2 = 25rc 2 + lOn + 1 = 5(5n 2 + 2«) + 1, 
(5 W + 2) 2 = 25rc 2 + 2(k + 4 = 5(5rc 2 + An) + 4, 
(5n + 3) 2 = 2Sn 2 + 2>0n + 9 = 5(5« 2 + 6n + 1) + 4, 
(Sn + 4) 2 = 25rc 2 + AOn + 16 = 5(5n 2 + 8/2 + 3) + 1, 

and the corresponding equations for numbers of the form 6n + m, 
show that if k 2 is divisible by 5 or 6, then k must be. The proof fails 
for V 4, because {An + 2) 2 is divisible by 4. (For precisely this reason 
this proof cannot be used to show that in general Va is irrational if 
a is not a perfect square — we have no guarantee that {an + m) 2 might 
not be a multiple of a for some m < a. Actually, this assertion is true, 
but the proof requires the information in Problem 16.) 
(b) Since 

{In + l) 3 = Sn* + \2n 2 + 6n + 1 = 2{An s + 6n 2 + 3n) + 1, 

it follows that if k* is even, then k is even. If $2 — p/q where p and 
# had no common factors, then p 3 — 2q z , so p z is divisible by 2, so p 
must be. Thus, /? = 2p' for some natural number //, and conse- 
quently {2p') z = 2q\ or 4(//) 3 = ? 3 - Thus, ? is also even, a contra- 
diction. 

The proof for vi is similar, using the equations 

(3„ + 1)3 = 27w 3 + 27/2 2 + 9rc + 1 = 3(9« 3 + 9n 2 + 3n) + 1, 

(3„ + 2) 3 = 27n 3 + 54n 2 + 36/z + 8 = 3(9rc 3 + 18/z 2 + 12n + 2) + 2. 

18. If n = 1, then (1 + A) n = 1 + nA. Suppose that (1 + h) n > 1 + »A. 
Then 

(1 + h )n+i = (i + h ){\ + A) n > (1 + A)(l + nh), since 1 + h > 0 
= 1 + (n + \)h + nh 2 > 1 + {n + l)h. 
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For h > 0, the inequality follows directly from the binomial theorem, 
since all the other terms appearing in the expansion of (1 + h) n are 
positive. 

chapter 3 1. (i) 0 + l)/0 + 2); the expression /(/(*)) makes sense only when 

x — 1 and x ^ — 2. 
(iii) 1/(1 + cx) (for x * -l/c if 0). 
(v) (* +^ + 2)/(* + l)(y + 1) (for x, y * -1). 
(vii) Only c = 1, since /(*) = /(«:) implies that x = cx, and this must 
be true for at least one x 0. 
> 0 and rational, or y > 1 . 

0. 

-1, 0, 1. 
{x: — 1 < at < 1 }. 
\x: x ^ 1 and a: ^ 2j. 



4. 
5. 

11. 



(i) 
(iii) 

(v) 
(i) 
(iii) 

(v) 

(i) 
(iii) 

(i) 
(iii) 

(v) 
(vii) 

(a) y. 

(b) H{y). 



2 2y . 

2 2sin< + sin(2 f ). 

Po S . 

S o S. 

PoP. 

Sos°SoPoPoPos. 



(c) H(y). 






12. (a) 


even 


odd 


even 


even 


neither 


odd 


neither 


odd 



(b) 



(c) 



even 
odd 

g even 
g odd 



even 



odd 



even 


odd 


odd 


even 



/ even / odd 



even 


even 


even 


odd 



(d) Let g(x) = /(*) for x > 0 and define g arbitrarily for x < 0. 
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21. (i) Let g(x) = h(x) = 1 and let / be a function for which /(2) ^ 
/(l) Then/o(^ + yi) ^fog + foh. 

(ii) [(£ + A) o f]( X ) = (g + h)(f(x)) = *(/(*)) + *(/(*)) = 

(5 ° /) W + (A 0 /) W = [(5 0 /) + (* o /)] W- 

(iii) t 1 - to - 77~rrr = 7 (*M) = A • g) to- 
/°£ /(£(*)) / V / 

(iv) Let g(x) = 2 and let/ be a function for which /(£) ^ l//(2). 
Then l/(/o^) *fo(l/g). 



CHAPTER 4 1. (i) (2, 4). 

(iii) [2, 4]. 



(v) (-2, 2). 

(vii) (-oo, 1]U[1, 00). 

2. (i) All points below the graph of f(x) = x. 
(iii) All points below the graph of fix) = x 2 . 

(v) All points between the graphs of f(x) = x + 1 and f(x) = * — 1 . 
(vii) A collection of straight lines parallel to the graph of fix) = —x, 
intersecting the horizontal axis at the points (n, 0) for integers n. 
(ix) All points inside the circle of radius 1 around (1, 2). 

3. (i) A square with vertices (1, 0), (0, 1), (-1, 0), and (0, -1). 
(iii) The union of the graph of f(x) = x and of f(x) = 2 — x. 
(v) The point (0, 0). 

(vii) The circle of radius around (1, 0), since x 2 — 2x + y 2 = 
ix-\) 2 +y 2 -\. 

5. (a) Simply observe that the graph of f(x) = m(x — a) + b = mx + 

(b — ma) is a straight line with slope m, which goes through the 
point (a, b). (The important point about this exercise is simply to 
remember the point slope form.) 

(b) The straight line through (a, b) and (c, d) has slope (d — b)/(c — a), 
so the equation follows from part (a). 

(c) When m = m' and b b' . In that case, there is clearly no number x 
with fix) — g(x), while such a number x always exists if m m' y 
namely, x — (b f — b)/(m — m'). 

6. (a) If B = 0 and A 5* 0, then the set is the vertical straight line formed 

by all points (x, y) with x = — C/A. If B ^ 0, the set is the graph of 
/to = (~A/B)x + (-C/A). 
(b) The points (x, y) on the vertical line with x — a are precisely the 
ones which satisfy 1 • * + 0 • jy + ( — a) = 0. The points (*, y) on 
the graph of f(x) = mx + b are precisely the ones which satisfy 
i-m)x + 1 - y+ {-b) = 0. 
10. (i) The graph of / is symmetric with respect to the vertical axis. 

(ii) The graph of / is symmetric with respect to the origin. Equiva- 
lently, the part of the graph to the left of the vertical axis is 
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obtained by reflecting first through the vertical axis, and then 
through the horizontal axis. 

(iii) The graph of / lies above or on the horizontal axis. 

(iv) The graph of / repeats the part between 0 and a over and over. 
19. (a) The square of the distance from (#, x 2 ) to (0, \) is 

= x * + x -+± 

2 16 
= (* 2 + i) 2 , 

which is the square of the distance from (x> x 2 ) to the graph of g. 
(b) The point (x, y) satisfies this condition if and only if 

(* - a y + (y - /3) 2 = (y-y) 2 , 

or 

x 2 - lax + a 2 + y 2 - 2/3y + £ 2 = y 2 - 2yy + y 2 , 



a 2 + /5 2 - y 2 \ 



.2/3 - 2y) \y - (3/ \ 20 - 2y / 

(This solution works only for (3 ^ y, which is just the condition that 
P is not on L. If P is on L, then the solution is the vertical line 
through P.) 



chapter 5 1. (ii) lim = lim (x 2 + 2x + 4) = 12. 

x->2 X — 2 x-»2 

(iv) lim — ~ ^ = lim x n ~ l + x n ~ 2 y + • • ■ + *)> n ~ 2 + ^ n " 1 

= y n ~ l + y n ' x + + y n ~* = wy"" 1 . 

, Va + A-V^ ■ (V a + h - + A + Vfl) 

(vi) lim = lim 7^ 

A k-+o h(V a + h + Va) 

= lim 



2. (i) It is possible to find 8 by beginning with the equation 

* 4 - a 4 = (* - a)(* 3 + a* 2 + a 2 * + a 3 ). 

If |* — a| < 1, then |*| < 1 + \a\, so 

\x* + ax 2 + a 2 x + a*\ < \x\* + \a\ • |*| 2 + |a| 2 ■ |*| + |a| 3 

< (1 + \a\) s + \a\(l + \a\) 2 + \a\ 2 (l + \a\) + |a| 3 ; 
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therefore we can choose 

S = mm 0' (I + \a\)> + \a\(l + \a\y + \a\*(l + \a\) + \a\)' 

It is instructive, and probably easier, to use part (2) of the lemma. 
This shows that \x 4 — a 4 \ < £ when 



2(| a |«+ 1) 

which is true when 

|,- a |< mi n^l, 2(W + i) 

= min ( 1 '4(| a |^ + i)(H + i)> 

(ii) By part (3) of the lemma, |l/# — 1| < £ when 



|# — 1| < min 



in I -> - ) = 
\2 2/ 



(hi) By part (1) of the lemma, |(* 4 + 1/x) - 2| < £ when |1 A - 1| < 
e/2 and (a: 4 — 1| < e/2. According to parts (i) and (ii) of this 
problem, this happens when 

\x — 1| < min f-> -> 1, — - — ^ = min (\> = 8. 
1 1 \2 4 5 8 • 2 • 2/ \2 32/ 

(v) Let 5 = £ 2 , since 0 < |*| < £ 2 implies that V|*| < e. 

(i) We need i/(x) - 2| < e/2 and \g(x) - 4| < e/2, so we need 

0 < |* - 2| < min (sin* + |, ~) = 5. 
(hi) We need 

|£M-4|<min(H^- 2 )> 

so we need 

0 < \x - 2| < [min(2, 8e)] 2 = 5. 
Let / = lim f(x) and define g(h) = /(a + h). Then for every £ > 0 

x—>a 

there is a 5 > 0 such that, for all x, if 0 < |* - a\ < 5, then \f(x) — I < e. 
Now, if 0 < |A| < 5, then 0 < \(h + a) - a\ < 5, so \f(a + h) - l\ < e. 
This inequality can be written — /| < £. Thus, lim g(A) = /, which 

can also be written lim f(a + h) = /. The same sort of argument shows 

that if lim /(a + h) — m, then lim f(x) = m. So either limit exists if the 

h-+Q x—*a 

other does, and in this case they are equal. 
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9. (a) Intuitively, we can get f(x) as close to / as we like if and only if we 
can get f(x) — / as close to 0 as we like. The formal proof is so 
trivial that it takes a bit of work to make it look like a proof at all. 
To be very precise, suppose lim f(x) = / and let g(x) — f(x) — I. 

x-*a 

Then for all £ > 0 there is a 8 > 0 such that, for all x, if 0 < 
\x — a\ < 8, then \f(x) — l\ < s. This last inequality can be written 
\g(x) — 0| < £, so lim g(x) = 0. The argument in the other direc- 

tion is similarly uninteresting. 

(b) Intuitively, making x close to a is the same as making x — a close 
to 0. Formally: Suppose that lim f(x) = /, and let g(x) = f(x — a). 

x — > a, 

Then for all £ > 0 there is a 6 > 0 such that, for all x, if 0 < \x — a\ 

< 5, then \f(x) - l\ < £. Now, if 0 < \y\ < 8, then 0 < \(y + a) - a\ 

< 8, so \f(y + a) — /| < £. But this last inequality can be written 
\g(y) ~ l\ < £. So lim g(y) = I. The argument in the reverse direc- 

tion is similar. 

(c) Intuitively, x is close to 0 if and only if x 3 is. Formally: Let 
lim f(x) — I. For every £ > 0 there is a 8 > 0 such that if 

0 < |*| < 8, then |/0) - l\ < £. Then if 0 < |*| < min(l, 8), we 
have 0 < |* 3 | < 8, so |/0 3 ) - l\ < £. Thus, lim f(x) - /. On the 

other hand, if we assume that lim f(x z ) exists, say lim /(* 3 ) = m, 

x—>0 x—>0 

then for all £ > 0 there is a 8 such that if 0 < \x\ < 5, then 
|/(* 3 ) - m\ < £. Then if 0 < |*| < 5 3 , we have 0 < | \Tx\ < 6, so 
|/([\^] 3 ) - m| < £, or \f(x) - m\ < £. Thus lim /(*) = m. 

(d) Let /(a:) = 1 for x > 0, and /(*) = - 1 for x < 0. Then lim f(x 2 ) 

2->0 

= 1, but lim /(*) does not exist. 

15. (a) The function f(x) = 1/* cannot approach a limit at 0, since it 
becomes arbitrarily large near 0. In fact, no matter what 8 > 0 may 
be, there is some x satisfying 0 < |#| < 5, butl/* > |/[ + £, namely, 
x = min(<5, \/{\l\ + £)). This x does not satisfy \\/x — l\ < £. 
(b) No matter what 5 > 0 may be, there is some x satisfying 0 < \x — 1 1 

< 5, but 1/0 - 1) > |/| + £, namely, x = min(l + 8, 1 + 1/ 
(|/| + £)). This a* does not satisfy \\/(x — 1) - /| < £. (It is also 
possible to apply Problem 9(b): lim 1/x = lim 1/0 — 1) if the 

2-+1 

latter exists, so this limit does not exist, because of part (a).) 
23. (i) This is the usual definition, simply calling the numbers 8 and £, 
instead of £ and 8. 
(ii) This is a minor modification of (i) : if the condition is true for all 
8 > 0, then it applies to 8/2, so there is an £ > 0 such that if 
0 < |* - a| < £, then I/O) - l\ < 8/2 < 8. 
(in) This is a similar modification: apply it to 8/5 to obtain (i). 
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(iv) This is also a modification: it says the same thing as (i), since 
e/10 > 0, and it is only the existence of some £ > 0 that is in 
question. 

27. If lim /(*) = lim /(*) = /, then for every £ > 0 there are 8 h 8 2 > 0 

x— *a + x— »a _ 

such that, for all x, 

if a < x < a + Si, then \f{x) - /| < £, 
if a - 8 2 < x < a, then \f(x) - l\ < £. 

Let <5 = min(Si 3 5 2 ). If 0 < |* — a| < 6, then either a — 8 2 < a — 
5 < a: < a or else a<#<0+5<<z + 5i, so \f(x) — /| < e. 

28. (i) If / = lim /(*), then for all £ > 0 there is a 5 > 0 such that 

x-»0 + 

I/O) - /| < £ for 0 < x < 8. If - 5 < x < 0, then 0 < -x < 5, 

so |/(-*) - l\ < e. Thus lim /(-*) = /. Similarly, if lim /(*) 

x-^o- co- 
exists, then lim /O) exists and has the same value. (Intuitively, 

x is close to 0 and positive if and only if —a: is close to 0 and 
negative.) 

(ii) If / = lim f(x), then for all £ > 0 there is a 8 > 0 such, that 

x->0 + 

I/O) - /| < £ for 0 < x < 8. So if 0 < |*| < 5, then |/(|*|) - /| 
< £. Thus lim f(\x\) = /. The reverse direction is similar. 

(Intuitively, if at is close to 0, then \x\ is close to 0 and positive.) 

(iii) If / = lim f(x), then for all £ > 0 there is a 8 > 0 such that 

x-*0 + 

I/O) - l\ < £ for 0 < x < 8. If 0 < |*| < VS, then 0 < x 2 < 5, 
so |/0 2 ) - /| < £. Thus lim /0 2 ) = /. The reverse direction is 

x— ►() 

similar. (Intuitively, if x is close to 0, then x 2 is close to 0 and 
positive.) 

31. If / = lim /0), then for every £ > 0 there is some N such that |/0) — l\ 

< £ for x > N, and we can clearly assume that N > 0. Now, if 0 < x < 
1/N, then 1/x > N, so \f(l/x) - l\ < s. Thus lim /(l/*) = /. The 

reverse direction is similar. 



chapter 6 1 . (i) FO) = x + 2 for all *. 

(iii) FO) = 0 for all x. 



CHAPTER 7 1. (i) Bounded above and below; minimum value 0; no maximum 

value. 

(iii) Bounded below but not above; minimum value 0. 

(v) Bounded above and below. It is understood that a > — 1 (so that 
-a - 1 < a + 1). If -1 < a < \, then a < -a - 1, so /(*) = 
a + 2 for all * in (-a - 1, a + 1), so a + 2 is the maximum and 
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minimum value. If — \ < a < 0, then /has the minimum value 
a 2 y and if a > 0, then / has the minimum value 0. Since a + 2 > 
{a + l) 2 only for [-1 - V5]/2 < a < [1 + V5]/2, when 
a > — i the function / has a maximum value only for a < 
[1 + \/5]/2 (the maximum value being a + 2). 

(vii) Bounded above and below; maximum value 1 ; minimum value 0. 

(ix) Bounded above and below; maximum value 1; minimum value 
-1. 

(xi) / has a maximum and minimum value, since / is continuous. 

2. (i) n = -2, since /(-2) < 0 < /(-l). 
(iii) n = -1, since /( — 1) = — 1 < 0 < /(0). 

3. (i) If /(*) = * 179 + 163/(1 + * 2 + sin 2 a:), then / is continuous on 

R and /(l) > 0, while /(-2) < 0, so f(x) = 0 for some * in 
(-2, 1). 

5. / is constant, for if / took on two different values, then / would take on 

all values in between, which would include irrational values. 
7. (1) /(*) = x; 

(2) f(x) = -x; 

(3) f(x) = \x\; 

(4) fa) = -|4 

10. Apply Theorem 1 to / — g. 

11. If /(0) =0 or /(l) - 1, choose x = 0 or 1. If /(0) > 0 = 7(0) and 
/(l) < 1 = 7(1), then Problem 10 applied to / and I implies that 
fix) = * for some 



CHAPTER 8 1 . (i) 1 is the greatest element, and the greatest lower bound is 0 3 which 

is not in the set. 
(iii) 1 is the greatest element, and 0 is the least element, 
(v) Since {x: x 2 + x + 1 > 0} = R, there is no least upper bound or 

greatest lower bound, 
(vii) Since {x: x < 0 and * 2 + x - 1 < 0} = ([-1 - Vs]/2, 0), the 
greatest lower bound is [ - 1 - V 5]/2, and the least upper bound 
is 0; neither belongs to the set. 
2. (a) Since A ^ 0, there is some x in A. Then — x is in — A, so —A ^ 0. 

Since A is bounded above, there is some y such that y > x for all x in 
A. Then -y < -x for all x in 4, so —y < z for all z in -^4, so 
—4 is bounded below. Let a = sup (--4). Then a is an upper 
bound for —A, so, reversing the argument just given, —a is a lower 
bound for A. 

Moreover, if (3 is any lower bound for A, then — (3 is an upper bound 
for -A, so -/S > a, so 0 < -a. Thus -a is the greatest lower 
bound for A. 

5. (a) If / is the largest integer with / < x, then / + 1 > x } but / + 1 < 
x + 1 < y. So we can let £ = / + 1. (Proof that a largest such 
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integer / exists: Since N is not bounded above, there is some natural 
number n with — n < x < n. There are consequently only a finite 
number of integers / with —n < I < x. Pick the largest.) 

(b) Since y — x > 0, there is some natural number n with 1/n < y — x. 
Since ny — nx > 1, there is, by part (a), an integer k with nx < 
k < ny, which means that x < k/n < y. 

(c) Choose r + V2 (s - r)/2. 

(d) By part (b), there is a rational number r with x < r < y, and there- 
fore a rational number s with x < r < s < y. Apply part (c) to 
r < s. 

10. Let k be the largest integer < x/a (the solution to Problem 5 shows that 
such a k exists), and let x' = x — ka > 0. If x — ka = x f > a, then 
x > (k + l)a, so k + 1 < x/a, contradicting the choice of k. So 
0 < x 1 < a. 

12. (a) Since any y in B satisfies y > x for all x in A, any y in B is an upper 

bound for A, so y > sup A. 
(b) Part (a) shows that sup A is a lower bound for B, so sup A < inf i?. 

13. Since x < sup A and < sup B for every a: in A, and in it follows 
that x + y < sup A + sup B. Thus, sup ^4 + sup B is an upper bound 
for A + B 7 so sup (^4 + B) < sup ^4 + sup B. If # and y are chosen in 
^4 and B, respectively, so that sup A — x < s/2 and sup B — y < e/2, 
then sup A + sup B — (x + y) < B. Hence, 

sup(A + B) > x + y > sup A + sup B — £. 



CHAPTER 9 1. (a) 

1 _ 1 

f {a) = lim /fr + *>-/(«> = l im l±A_i 

= lim = — — 

fc-+o a(a + A) a 2 

(b) The tangent line through (a, 1/a) is the graph of 

— 1 1 

g(x) = — (x - a) + - 
a 1 a 

a 2 a 



If /(*) = g(x), then 



1 ^ _ ^ + 2 



so # = a. 
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2. (a) 

_1 

r(a) , lim /(« + *)-/(«) m lim (, + *)« ; 

(-2*A - A 2 ) 2 

= lim = 

fc-o Aa 2 (a + A) 2 a 3 

(b) The tangent line through (a, 1/a 2 ) is the graph of 
g(x) - ~ » (* " a) + i 

/7* /7 2 



= _2^ 3 
a 3 a 2 " 



3. 



If /to «*(*), then 

1 = — + 1 
* 2 a 3 a 2 ' 

or 

2x 3 - 3a* 2 + a 3 = 0, 

or 

0 = (* - a)(2* 2 - ax - a 2 ) = (* - a)(2* + a)(* - a). 

So x = a or x — —a/2; the point (—a/2, 4/a 2 ) lies on the opposite 
side of the vertical axis from (a, 1/a 2 ). 



f(a) = lim & + k) ~ M = lim ~ ^ 

fc-»0 A h~>0 h 

(Va + A - Vtf)(Va + A + Vfl) r A 
= lim — = lim — 

^° A(V a + A + Va) A(VT+A + vi) 

= 1 
~ 2 

4. Conjecture: = nx n ~\ Proof: 

= lim S » (X + h) ~ S " (X) = lim + 
h-+o A h-+o h 



= lim 5 ^- 



20--'*'- 

/-I 

= ^ a: 11 " 1 = nx n ~\ since lim A*" 1 = 0 for ; > 1. 



= lim 

h-+Q 

i-i 
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5 # f(x) = 0 for x not an integer, and /'(*) is not defined if x is an integer. 

6. (a) 

„, v g(x + h) - gjx) [fx + h) + c] - [f(x) + c] 
S (x) = hm 2 = lim 



= lim /(* + *)-/(*) =m 

a-*o h 



(b) 



v g(* + h) - g{x) cf(x + h) - cfjx) 

g (x) = hm = lim 

h-*o h *->o n 

h-^o h 

7. (a) /'(9) = 3 • 9 2 ; /'(25) = 3 • (25) 2 ; /'(36) = 3 • (36) 2 . 

(b) /'(3 2 ) = /'(9) = 3 • 9 2 ;/'(5 2 ) = /'(25) = 3 ■ (25) 2 ; 
/'(6 2 ) = /'(36) = 3 • (36) 2 . 

(c) /'(a 2 ) = 3(« 2 ) 2 = 3a 4 ; f'(x 2 ) = 3(x 2 ) 2 = 3*<. 

(d) /'(* 2 ) = 3x 4 ; but g(x) = * 6 , so = 6* 5 . 

8. (a) 

„ * .. g(x + h) — g(x) f(x + h + c)- f(x + c) 

= lim /([* + *] + *)-/(« + '> = f(x + C ). 
ji-»o A 

(b) 

,'(,) = lim SiX + k) ~ eix) = lim /i f* + £*> - *"> 

c[f(cx + ch) - fcx)] .. - + *) - f(cx)] 
= hm = lim 

h-*0 Ch k^O K 

= c -lim /(CX + k) ~ /{CX) =c-f'(cx). 
h->o k 

(Compare the manipulations in this calculation with Problem 5-13.) 
(c) If g(x) = f(x + a), then g'(x) = fix + a), by part (a). But 
g = f 9 so f{x) = g'(x) = fix + a) for all x, which means that /' 
is periodic, with period a. 

9. (i) Ifg(x) = x\ then g'(x) = 5x\ Now fx) = g(x + 5), so by Prob- 

lem 8(a), f{x) = g\x +5) = Six + S)\ 
(ii) fx) = ix - 3) 5 , so fix) = 5ix - 3)\ as in part (i). 
(hi) fx) = (* + 2) 7 5 so /'(*) = 7(* + 2) 6 , as in part (i). 

10. If fx) = git + *), then fix) = + *), by Problem 8(a). If ft) = 
git + x), then fit) = g\t + *), by Problem 8(a), so fix) = £'(2*). 

11. (a) If s[t) = ct 2 , then s\t) = 2c/, and there is no number k such that 

s '( t ) = [that is, 2c/ = to 2 ] for all t. 

(By the way, at this point we do not know any nonzero function / for 
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which /' is proportional to /. After Chapter 17 it might be amusing 
to determine what the world would be like if Galileo were correct.) 



(b) (i) If s(t) = (a/2)t 2 , then s'(t) = at, so s"(t) = a. 
(ii) [/(<)]> = (at) 2 = 2a • (a/2)t 2 = 2as(t). 

(c) The chandelier falls s(t) = 16/ 2 feet in / seconds, so it falls 400 feet 
in t seconds if 400 = \6t 2 , or t = 5. After 5 seconds the velocity will 
be /(5) = 5a = 5 • 16 = 80 feet per second. The speed was half 
this amount when 40 = s'(t) = 16*, or t = -f. 

21. (a) This is another way of writing the definition (see Problem 5-8). 

(b) This follows from Problem 5-10, applied to the functions a(h) = 
[f(a + h) - f(a)]/h and 0(A) = [g(a + h) - g(a)]/h. 
26. (i) /"(*) = 6x. 

(hi) f f (x) = 4x 3 . 
30. (i) means that f'(a) = na n ~ l if /(x) = a: 71 . 

(iii) means that g'(a) = /'(a) if = /(*) + c 

(v) means the same as (iii). 

(vii) means that g'(b) = f(b + a) if g(x) = f(x + a). 
(ix) means that g'(b) = cf{cb) if g(x) = f(cx). 



(vii) (cos(x + sin x)) • (1 + cos x). 
2. (i) (cos((x + l) 2 (x + 2))) • [2(x + 1)(* + 2) + (x + l) 2 ]. 

(iii) [2 sin((x + sin x) 2 ) cos((x + sin x) 2 )] ' 2(x + sinx)(l + cos *)■ 
(v) (cos(x sin a:)) • (sin x + x cos x) + (cos(sin x 2 )(cos a* 2 )) • 2x. 
(vii) (2 sin x cos x sin x 2 sin 2 x 2 ) + (2x cos x 2 sin 2 x sin 2 x 2 ) 

+ (sin x 2 cos sin 2 x sin x 2 ). 
(ix) 6(x + sin 5 x) 5 (l + 5 sin 4 x cos x). 

(xi) cos(sin 7 x 1 + I) 7 • 7(sin 7 x 1 + l) 6 ■ (7 sin 6 x 7 ■ cos x 7 • 7x 6 ). 
(xiii) cos(x 2 + sin(x 2 + sin x 2 )) ■ [(2* + cos(x 2 + sin x 2 ) 
- (2x + 2x cos x 2 ))]. 

(1 + sin x)(2x cos x 2 • sin 2 x + sin x 2 • 2 sin x cos x) 



CHAPTER 10 



(i) 
(iii) 



(1 + 2x) • cos(x + x 2 ). 
(— sin x) * cos (cos x). 




(XV) 



— cos x sin x L sin' 5 x 



(1 + sin x) 
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4. 



(i) 



{x + 2Y 



(iii) 

(i) 


2x*. 
-x 2 . 




(iii) 


17. 




(i) 


/'(*) 


= g'ix + gia)) 


(iii) 


fix) 


= g'ix + g(x)) 


(v) 


fix) 


= gia). 



7. (a) A'(t) = 2wr(ty(t). Since r\t) = 6 for that f with r(t) = 4, it follows 
that A'(t) = 2tt • 4 • 6 = 48?r when r(0 = 4. 

(b) If F(0 is the volume at time t, then V(t) = 47rr(/) 3 /3, so = 
4?rr(0 V(0 = 4?r • 4 2 • 6 = 384tt when r(t) = 4. 

(c) First method: Since A'(t) = 2Trr(t)r f (t), and A'(t) = 5 for r{t) = 3, 
it follows that 



r'H) = 



il'W _ 5 



— — when r(/) = 3. 



2wr(t) 6tt 



Thus 




= 30 when r{t) = 3. 



To apply the second method, we first note that if 



/« = ^W 3/2 = VA(t)\ 



then, using Problem 9-3 and the Chain Rule, 



fit) 




%A(t) ll2 A'(i) (just as we might have guessed). 



Now 



V(t) = 



4wr(t) 3 = 4*-[r(0»]"» 
3 3 

4[7rr(Q 2 ] 3 / 2 
3tt 1/2 



4A(t) 312 
37T 1 / 2 ' 
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So 

= A . T u2 r(t)A > (t) 

= 2 • 3 • 5 = 30. 

8. (i) (/• A)'(0) = f(h(0)) ■ A'(0) = /'(3) • sin 2 (sin 1) 
= 9 (sin -g-)sin 2 (sin 1). 
(iii) a'(x 2 ) = h'ix 4 ) • 2x 2 = sin 2 (sin(x 4 + 1)) • 2x 2 . 
10. The Chain Rule implies that 

Q'w = (/•«)'(*) = /'g?w w« 

30. (i) d l = d £. d l = (cos ,) • (1 + 2x) = (cos(* + x 2 )) • (1 + 2x). 
dx dy dx 

(iii) d ± = ^ . * = (- S in w ) • (cos x) = (- cos(sin *)) ■ (cos x). 
dfo d/x 



CHAPTER 11 1. (i) 0 = /'(*) = 3x 2 - 2* - 8 for x = 2 and x = both of which 

are in [ — 2, 2]; 

/(-2) = 5,/(2) = -n,/(-i) = W; 

maximum = -gy 3 -, minimum = —11. 
(iii) 0 = /'(*) = 12x 3 - 24x 2 + 12x = 12x(x 2 - 2x + 1) for x = 0 

and x = 1, of which only 0 is in [— 2, i]; 

fi-h) = «,/(*) =H,/(0) =0; 

maximum — yf , minimum = 0. 
( V ) 0 = /'(x) = 

x 2 + 1 - (x + l)2x 1 - 2x - x 2 



(x 2 + l) 2 (x 2 + l) 2 

forx = -1 + V2andx - -1 - V2, of which only -1 + V2 
is in [-1, \]\ 

/(-I) = 0, f{\) = f, /(-l + V2) = (1 + V2)/2; 
maximum = (1 + V2)/2, minimum = 0. 
2. (i) — -g- is a local maximum point, and 2 is a local minimum point, 
(iii) 0 is a local minimum point, and there are no local maximum 
points. 

(v) - 1 + V2 is a local maximum point, and — 1 — V2 is a local 
minimum point. 
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3. (a) Notice that / actually has a minimum value, since / is a polynomial 

function of even degree. The minimum occurs at a point x with 

n 

0 = /'(*) = 2 T (* - at), 

1 = 1 

so * = (ai + • * • + a n )/n. 

4. (i) 3 and 7 are local maximum points, and 5 and 9 are local minimum 

points. 

(iii) All irrational x > 0 are local minimum points, and all irrational 

x < 0 are local maximum points, 
(v) x is a local maximum (minimum) point if the decimal expansion 

contains (does not contain) a 5. 

5. If /(*) is the total length of the path, then 

/(*) = Vx 2 + a 2 + V(l - x ) 2 +b 2 . 
The positive function / clearly has a minimum, since lim f(x) — 

X—* 0° 

lim f(x) = oo, and / is differentiate everywhere, so the minimum 
occurs at a point * with f'{x) = 0. Now, /'(#) = 0 when 

* _ (1 - *) = Q 

Vx 2 + a 2 V(l - x) 2 + b 2 

This equation says that arctan a = arctan j3. 

It is also possible to notice that f{x) is equal to the sum of the lengths 
of the dashed line segment and the line segment from (x, 0) to (1, b). 
This is shortest when the two line segments lie along a line (because of 
Problem 4-8 (b), if a rigorous reason is required); a little plane geometry 
shows that this happens when a — /5. 

6. If at is the length of one side of a rectangle of perimeter P, then the length 
of the other side is (P — 2x)/2, so the area is 

= X JP - W 
2 

So the rectangle with greatest area occurs when x is the maximum point 
for / on (0, P/2). Since A is continuous on [0, P/2], and A(0) = 
A(P/2) = 0, and A{x) > 0 for x in (0, P/2), the maximum exists. 
Since A is differentiate on (0, P/2), the minimum point x satisfies 

0 = A'(x) = 1^l2± - x 
2 

= P Z AX : 

2 



so x - P/4. 
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7. Let S(r) be the surface area of the right circular cylinder of volume V 
with radius r. Since 

V = >irr?h where h is the height, 
we have h = F/xr 2 , so 

S(r) = 2irr 2 + 2wrh 
2V 

= 2wr 2 + — • 
r 

We want the minimum point of S on (0, « ) ; this exists, since lim £(r) = 

r->0 

lim 5(r) = oo. Since S is differentiable on (0, oo), the minimum point r 

r- ► » 

satisfies 

2V 

0 = £'(r) = 4?rr - — 
r 2 

47rr 3 - 2V 



or 



3 

r = 



2r 



8. 1 is a local maximum point, and 3 is a local minimum point. 
14. (a) We have 

m - f(a) = f{x) for some x in (a, b) 
b — a 

> M, 

so f(b) - f(a) > M(b - a). 
(b) We have 

f(b) ~ f(a) = ^ for some ^ in ( ^ 6) 
b — a 



so - /(«) < iti(* - a). 
(c) If |/(*)| < for all x in 0, b], then -Af < /(*) < M, so 
/(«) - Af(A - a) < f(b) < f(a) + M(b - «), 

or 

|/(*) ~ /Ml < M(b - a). 

16. (a) /(*) = — cos a: + a for some number a (because fix) = — cos x is 
one such function, and any two such functions differ by a constant 
function). 
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(b) fix) = x 4 /4 + a for some number a, so f(x) = x 5 /20 + ax + b for 
some numbers a and b. 

(c) /'(*) = x 2 /2 + * 3 /3 + a for some a, so /'(*) = x z /6 + x*/12 + 
ax + b for some a and b, so /(*) = * 4 /24 + x 5 /60 + ax 2 /2 + bx + c 
for some numbers a, b, and £. Equivalently, and more simply, 
fx) — x 4 /24 + x b /60 + ax 2 + bx + c for some numbers a, b, and c. 

17, (a) Since = -32, we have = -32* + a for some a, so 

j(0 = — \(>t 2 + a* + j8 for some a and jff. 

(b) Clearly, s(0) = 0 + 0 + 0 and j'(0) = 0 + a. Thus, a: = v 0 and 
0 = Jo- 

(c) In this case, j 0 = Oand^o = v, so s(t) = — 16/ 2 + ^. The maximum 
value of s occurs when 0 = s'(t) = — 32/ + v, or * = y/32, so the 
maximum value is 



— zr V L 
~ ~64 32 

= EL. 
64* 

At that moment the velocity is clearly 0, but the acceleration is —32 
(as at any time). The weight hits the ground at time t > 0 when 

0 = s (t) = -I6t 2 + vt, 

or t = v/\6 (it takes as long to fall back down as it took to reach the 
top). The velocity is then 



✓(»/16) = -32 (^) + v 



(the same velocity with which it was initially moving upward). 
29. Apply the Mean Value Theorem to f(x) = V* on [64, 66]: 

V66 - V64 1 

~ — = fix) = 7^ for some x in [64, 66]. 

66 - 64 2 V x 

Since 64 < x < 81, we have 8 < < 9, so 

1 a/66 - 8 1 
2 • 9 2 < 2 • 8* 

33. L'H6pitaPs Rule does not lead to the equation 

3* 2 + 1 „ 6x 
lim — = lim — 

:r-+l 2* — 3 x— 1 2 

because lim 3* 2 +1^0. 

x-»l 



I 
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34. (i) 
(ii) 



x 1 

lim = lim — — = lim cos 2 x — 1. 

x->o tan x x-»o sec 2 x x-*o 



cos 2 x — 1 .. 2 sin at cos x „ 

lim = lim = 1 . 

x->o a: 2 x->o 2x 



CHAPTER 12 1. (i) f-\x) = (x - 1) 1/3 . (If y = fK*)* then * = /(» = / + 1, so 

y = (* - l) 1/3 -) 

(iii) r 1 = /. (If > = rK*)> then 

,-/(*)-( ^ ^ rati0nal 
yw ( —y, y irrational; 

since ±y is rational or irrational if and only if y is, we have 
y = * if * is rational and = — * if x is irrational, so y = /(*).) 

(v) 

Ix, x ^ ai, . . . , a n 
x = fl t -, i = 2, . . . , n 
a n , x = ai. 

(vii) r 1 -/- 

2. (i) f~ l is increasing and f~ l {x) is not defined for x < 0. 
(iii) f 1 is decreasing and / -1 (^) is not defined for x < 0. 

4. Suppose / is increasing. Let a < b. Then f~ l (a) * f~ l (b) } since / -1 is 
one-one. So either fK*) < -TW or f~ l (a) > f'Kb)- But if f^a) > 
f~ l (b), then 

* = fU~Kb)) < fiTKa)) = «, 

a contradiction. The proof is similar for decreasing /, or one can con- 
sider — / instead. 

5. Clearly, / + g is increasing, for if f(a) < f(b) and g(a) < g(b), then 
(f+g)(a) = f{a) + g(a) < f(b) + g{b) = (/ + g)(b). 

f-gis not necessarily increasing; for example, if /(x) = g(x) = x. (But 
/ • g is increasing if /(x) > 0 for all x.) 

fo g is increasing, for if a < b, then < so f(g(a)) < f(g(b)). 

6. (a) If (fo g)(x) = (/o so that /(*(*)) = f(g(y)), then g(x) = 

g(y) y since / is one-one, so x = >>, since g is one-one. 

(f og )-i = ^-i o /-i; for if j = (/o^)-i(x),thenx = (f * g)(y) = 

f(g(y))> so *O0 = r'to, so , = g-KHW). 

7. If/(x) = /(>), then 

ax + 6 _ ay + 6 
cx + d cy + i 
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so 

acxy + bey + adx + bd = flcry + ady + ftc* + bd, 

or 

<z<f(# — jy) — bc(x — jy). 

If <2^ =^ ftc, this implies that x — y = 0. (ButifW = ft£, then /(#) = f(y) 
for all * and y in the domain of /.) 
If y = / -1 (V)> men * = /W? so 

# v + ft 

x = — > 

+ 

so 

f~ 1 (x) — y = — — — for x 9* a/c. 
cx — a 

8. (i) Those intervals [a, ft] which are contained in (— oo, 0] or [0, 2] or 
[2, oo ), since / is increasing on (— qo, 0] and [2, oo) } and decreas- 
ing on [0, 2]. 

(iii) Those intervals [a, ft] which are contained in (—<*>, 0] or [0, <*>)> 
since / is increasing on ( — <», 0] and decreasing on [0, oo). 
14. The formula for the derivative reads: 

dx = J_ 
dy dy 
1x 

(In this formula, it is understood that dx/dy means (f~ l )'(y) 3 while dy/dx 
is an "expression involving and in the final answer x must be replaced 
by y, by means of the equation y = /(#).) 
The computation in Problem 14, when completed, shows that 

dx" n 1 1 



dx nix 11 * 1 ) 71 ' 1 

= 1 y (l/n)-l 



is. ax) = x(ry(x) + - F'irK*)) - (ro'w 
= ^rrw + r j w - /(/->«) • cryw 

16. (i) 



A\A~ 1 (3)) A'(0) sin 2 (sin 1) 
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17. Since 



we have 



crrw = 



(ri) ' w = /lrW 
-/"(r i w) • (r i )'w 



[/'cnw)] 2 



CHAPTER 13 1. If P n ={*„,...,<„} is the partition with = ib/n, then 

n 

n-1 

b * f (»- *) 4 , (" - i) 3 , (» - D' l 

and similarly 

n 

3 = 1 

"«44 + 2 + 4j" 

Clearly L(f, P n ) and U(f, P n ) can be made as close to b 4 /4 as desired by 
choosing /. sufficiently large, so £/(/, /> n ) - £(/, P n ) can be made as 
small as desired, by choosing n large enough. This shows that / is 
integrable. Moreover, there is only one number a with L(/, P n ) < a ^ 
£/(/, P n ) for all w; since x 3 dx has this property, the proof that J Q * 3 dx 
= 6 4 /4 will he complete once we show that £(/, P„) < £ 4 /4 < £/(/, AO 
for all This can be done by a straightforward computation, but it 
actually follows from the fact that L(f, P n ) and £/(/, jP n ) can be made 
as close to 6 4 /4 as desired by choosing n sufficiently large. In fact, if it 
were true that b 4 /4 < x 3 dx, then it would not be possible to make 
U(f, P n ) as close as desired to b 4 /4 by choosing n large enough, since each 
V(f, Pn) > Jq x 3 dx, and similarly we cannot have 6 4 /4 > j* x* dx. 



2. 



We have 



30 



(vii) 

5. (i) 
(iii) 
(v) 

6. 



ly L(f, P n ) and U(f, P n ) can be made as close to b b /5 as desired 
loosing n large enough. As in Problem 1, this implies that 

dx = £ 5 A 



(For a rigorous proof that the functions in (i), (iii), and (vii) are 
integrable, see Problem 15. The values of the integrals, which are 
clear from the geometric picture, can also be deduced rigorously 
by using the ideas in the proof of Problem 1 5, together with known 
integrals.) 




(v) / is not integrable. 







jl (// ^ g ^ dy ) dx = f* ( ^ fo g ^ dy ) dx (herC ^ iS thC constant) 
= // g(y) dy /; /(*) dx 



(here j g(y) dy is the constant). 



10. 



(a) Clearly L(f, P) > 0 for every partition P. 

(b) Apply part (a) to / — g, and use the fact that 




27. 



24. 



(a) 0. 

(b) i 

(a) Clearly 



m{b - a) < L(f, P) < U(f, P) < M(b - a) 
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for all partitions P of [a, b]. Consequently, 

m(b - a) < j* f(x) dx < M(b - a). 

Thus 




satisfies m < fi < M. 
(b) Let m and M be the minimum and maximum values of /on [a, b]. 
Since / is continuous, it takes on the values m and Af, and conse- 
quently the number fx of part (a). 
31. Since 

-l/l</<l/l, 

we have 
so 

(Problem 30 implies that f b \f \ makes sense.) 



CHAPTER 14 1. (i) (sin 3 x 3 ) • 3* 2 . 

fx I 

(iii) / 1 dt. 

K J Js 1 + t 2 + sin 2 f 

(v) / -dt. 

W Ja 1 + t 2 + sin 2 t 

2. (i) All x 9* 1. 
(iii) All x 5* 1. 
(v) All x. 

(vii) All ^ 0. (F is not differentiable at 0 because F(x) = 0 for x < 0, 
but there are x > 0 arbitrarily close to 0 with F(x) = \.) 

3 * (0 11 

(/ ~ 1)/(0) = /XrW) = 1 + sin(sin(/- 1 (0))) 

= » = 1. 

1 + sin (sin 0)) 

4. F(*) = * /;/(<) dt, so 

f'w = */« + /;/(<)*. 



550 Answers to Selected Problems 



9. We can choose 

/to = 



2. 



1 + 1 

n 



Then 



£<l/n) + l 

V^rf* = /(*) -/(0) = 



i+1 

n 



CHAPTER 15 1. (i) 



(hi) 



1 + arctan 2 (arctan x) 1 + arctan 2 x 1 + x 2 
1 



1 + (tan x arctan 



(. tan x \ 
sec 2 x arctan x + 



(i) 


0. 


(hi) 


0. 


(v) 


0. 


(a) 


sin 2x = 




cos 2x = 




sin 3a: = 



6. (a) sin 2a: = sin(# + x) = sin * cos # + cos a* sin a: = 2 sin # cos a;. 

cos 2 x — sin 2 x = 2 cos 2 x — 1 = 1 — 2 sin 2 
sin (2a: + a:) = sin 2a: cos x + cos 2a: sin x 
= 2 sin a* cos 2 x + (cos 2 x — sin 2 x) sin # 
= 3 sin a: cos 2 x — sin 3 a:. 
cos 3a: = cos (2a: + x) = cos 2a: cos x — sin 2a: sin x 

= (cos 2 a: — sin 2 x) cos a: = 2 sin 2 * cos a: 
= cos 3 x — sin 2 a: cos x — 2 sin 2 x cos a: 
= cos 3 x — 3 sin 2 a: cos a: 
= 4 cos 3 x — 3 cos a:. 
(b) Since cos 7r/4 > 0 and 



7T _ 7T „ 7T . 

0 = cos - = cos 2 * - = 2 cos 2 - — 1, 
2 4 4 

we have cos tt/4 = V2/2. It follows, since sin ir/A > 0 and sin 2 + 
cos 2 = 1, that sin 7r/4 = V2/2, and consequently tan 7r/4 = 1. 
Similarly, since cos 7r/6 > 0 and 



7T ^^.q^o 71 " 

0 = cos - = cos 3 * - = 4 cos 3 cos -> 

2 6.6 6 
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we have cos w/6 = \^3/2. It follows, since sin w/6 > 0, that 
sinx/6 = ^1 - (V3/2) 2 = i 

8. (a) 

sin (a: + jp 

tan(* + y) = — - — - 

cos (a: + jy) 

sin # cos jy + cos # sin y 

cos a: cos y — sin ^ sin y 

sin x cos j cos x sin j> 

cos # cos y cos # cos y 

cos * cos jy sin x sin jy 

cos x cos jy cos # cos y 

tan a: + tan y 



1 — tan x tan jy 

(b) From part (a) we have 

. . tan(arctan x) + tan(arctan y) 

tan (arc tan x + arc tan y) = 



1 — tan (arc tan x) tan (arc tan y) 
x + y 



1 — xy 

provided that arctan arctan y, and arctan x + arctan y 5* 
kir + 7r/2. Since —7r/ 2 < arctan x } arctan < 7r/2, this is always 
the case except when arctan x + arctan^ = ±7r/2, which is equiva- 
lent to xy = 1 . From this equation we can conclude that 

/ x ~\~ y \ 

arctan x + arctan y = arctan ( ) 

\1 - xy) 

provided that arctan x + arctan y lies in (— 7r/2, 7r/2), which is 
true whenever xy < 1. (If x, y > 0 and xy > 1, so that arctan * + 
arctan jy > 7r/2, then we must add 7r to the right side, and if x, 
y < 0 and ry •> 1, so that arctan x + arctan y < —ir/2, then we 
must subtract 7r.) 

10. The first formula is derived by subtracting the second of the following 
two equations from the first: 

cos (m — n)x — cos (mx — nx) = cos mx cos(-nx) — sin mx sin( — nx) 

= cos mx cos nx + sin mx sin nx, 
cos (m + n)x — cos 01* cos nx — sin tw* sin nx. 



The other formulas are derived similarly. 



11. It follows from Problem 10 that if m ^ n, then 

sin mx sin nx dx — \ [cos(m — n)x — cos(m + n)x] dx 

_ 1 | [sin (m — n)w sm(m + «)tt] 
2 IL m — n m + n J 

[ sin(m — n)ir _ sin(m + n)T *l| 
m — n m + n JJ 

= 0. 

But if m = n, then 

sin m* sin n* </* = ir J*^ 1 ~~ cos(m + n)x dx 

= k{[ir — cos(m + n)7r] — [— x — cos(m + 

= 7T. 

The other formulas are proved similarly. 
14. (a) We have 

cos 2x = cos 2 x — sin 2 x 
= 1-2 sin 2 * 
- 2 cos 2 * - 1. 



So 



sin 2 * = 



cos 2 * = 



1 — cos 2x 

j 

2 

1 + cos 2x 



(b) These formulas follow from part (a), because cos x/2 > 0 and 
sin x/2 > 0 (since 0 < x < ir/2). 

(c) 

j sin 2 x dx = I dx = - (b — a) (sin 2b — sin 2a). 

Ja Ja 2 2 4 

[ h * j /* 6 1 + cos 2x 1 x , 1 , . . - v 

/ cos 2 x dx = j </x * - (b — a) + - (sin 2b — sin 2a). 

Ja Ja 2 2 4 

18. (a) arctan 1 — arctan 0 — t/4. 

(b) lim arctan x — arctan 0 = tt/2. 

x—* • 

1 9. lim x sin - = lim - sin x = 1 . 

x->« x x-*0 + x 

20. (a)(sinTW=^cos(^)=^cos^). 
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sin°* sin(7T*/180) tt sin(ir*/180) ?r 

< b) S^T = Si i = ™ 18<)' „/180 " 180 

Jim # sin - = hm = — — • 

x_>« * x-^o + a: 180 



CHAPTER 17 1. (i) e e ** • e e '* • • a* 

(iii) (sin *) 8in(sin:r) [(log(sin *)) • cos(sin *) • cos x 

+ (cos */sin x) • sin(sin a:)]. 

(v) sin x ein * ,in *[(log(sin *)) ' sin * 8in x 

• {(log(sin *)) ' cos x + (cos x/sin x) • sin *} 

+ (cos jc/sin at) • sin * 8in *]. 



(vii) [arcsin (^J^^fa (arcsin (^))) 



(cos 
sin ? 



+ log (sin **) 



sin x — cos * 



arcsin | 



\sm at/ * \sm */ 
(ix) (log *) log * ■ [logOog *) • i + log * ' ' 



• sin- 4 a: 



3. (i) 0. 

(iii) i 

(v) i 

5. (a) 



cosh 2 x — sinh 2 * = ( — J — I — J 



= 1. 



(c) 



sinh x coshjy + cosh a: sinhjy = ( 1 I J -r ^ ~ ^ ^ ^ y 



gx+y e -x-v e -*+v e*-v~\ V e x +y e - *^ e~ x+v e"* -2 '] 

ir + ~i r + "Tj + L"T + "r + "T""~^J 

= ! = smh (a: + y). 

2 



(e) Since 



sinh x = 



e + e" 
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we have 



sinh' (at) = = cosh x. 

K } 2 



(g) Since 

. sinh x 

tanh x = 1 

cosh x 

we have 

(cosh x) 2 — (sinh x) 2 



tanh'(*) = 



by part (a). 



cosh 2 x 

6. (a) If y = arg cosh x, then * > 0 and 

x = cosh^ = y/\ + sinh 2 ;; by part (a). 

So 



sinh (arg cosh x) — sinh y = V* 2 — 1 since sinh y > 0 for y > 0. 

(c) 



(arg sinh)' (*) = 



1 



(e) (arg tanh) 7 W 



sinh '(arg sinh (a:)) 

1 

cosh (arg sinh(#)) 
1 

VT+x~ 2 bypart (b) * 
l 



tanh 7 (arg X.axih(x)) 
= cosh 2 (arg tanh(#)). 

Now, 

tanh 2 jy + — - — = 1 by Problem 5(b), 
cosh 2 j/ 

so 

tanh 2 (arg tanh(*)) + — — — = 1, 

cosh 2 (arg tanh(#)) 

or 

1 



cosh 2 (arg tanh(*)) = 



1 - x 2 

7. (a) If y = arg sinh x, then 

x = sinh = 
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so 



e v - € -y = 2x, 
e™ - 2xe v -1=0, 



2x ± Vax 2 + 4 



so 



or 



e v = x + Vl + x 2 since e y > 0 
y = arg sinh x = log (a* + Vl + a 2 ). 

Similarly, 

arg cosh x = \og(x + V* 2 — 1), 
arg tanh x = i log(l + a) — ilog(l — *). 

(b) 

f 6 1 

/ — — = dx = arg sinh 6 — arg sinh a by Problem 6(c) 
J a Vl + * 2 ~ 

= logO + Vl + b 2 ) - log(a + Vl + a 2 ). 
P . 1 & = log(£ + V* 2 - 1) - log(a + Va 2 - 1). 

Ja Vx 2 - 1 

f — ^— , <fe - - [log(l + b) - log(l - A) - log(l + a) + log(l - «)]. 
; fl 1 - r 2 

8. (a) lim a* = lim e xlo * a . Since log a < 0, we have lim x log a = - oo, 

X— ► oo x— > oo ' x—* oe 

so lim e xlo * a = 0. 

(c)1 jM^-lim£-0. 

x-^ oo ^ y-* * e y 

(e) lim = lim e zlogX . Now, lim a: log x = 0 by part (d), so lim x* = 1. 

x->0+ x->0+ x->0+ x->0 + 

12. (a) lim log(l +y)/y = log'(l) = 1- 

(b) lim x log(l + l/x) = lim log(l + y)/y = 1. 

x— ► oo y— *0 + 

(c) 

« = exp(l) = exp(lim x log(l + l/x)) 

X — > oo 

(*) = lim exp(xlog(l + l/x)) 
= lim (1 + l/x) x . 

x-+ 00 

(The starred equality depends on the continuity of exp at 1, and 
can be justified as follows. For every £ > 0 there is some 8 > 0 such 
that \e - exp y\ < £ for \y — 1| < 8. Moreover, there is some N such 
that|*log(l + l/x) - 1| < 8forx > N.So\e - *log(l + \/x)\ < 6 
for x > N. 
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(d) 

e a = [lim (1 + \/x) x f = lira (1 + \/x) ax 

X—* » X—* oo 

= lim (1 + 1 /x) ax 

OX—* W 

= lim (1 + a/y) v . 

y — * oo 

14. After one year the number of dollars yielded by an initial investment of 
one dollar will be 

lim (1 + a/100 x) x = e a ' 100 . 

X — > 00 

15. Clearly /'(*) = 1/x for x > 0. If x < 0, then f(x) = log(-x), so 
f{x) = (_!).!/(-*) = l/ x . 

16. Lctg(x) = f(x)/e cx . Then 

aU \ - ^/(^) - f(*)ce cx 



so there is some number A: such that g(x) — k for all a:. 

17. (a) According to Problem 16, there is some k such that A{t) = £<? ct . 

Then k = - A 0 . So = ^ c *. 
(b) UA(t + r) = A(t)/2 9 then 

4^ = 

2 

so <?<V T = e ct /2 or * CT = ^,sor = - (log 2)/c. It is easy to check that 
this r does work. 

18. Newton's law states that, for a certain (positive) number c, 

T'{t) = c(T - M) y 

which can be written 

(T - MY = c(T - M). 
So by Problem 16 there is some number A: such that 

T(t) - M = ke ct , 
and k = ke*' = 7(0) = 7V So T(t) = M + 7V cf . 



CHAPTER 18 1. (i) (V^a + ^c/Vx = a; 1 ' 10 + aT 1/3 ). 

1 V x - 1 - V* + 1 

(n) 7 , — = 

(iii) (* x + + * 3x )A 4 * == e'* x + + e~ x . 

(iv) o*/P = ( fl /*)* = ,*io« («/&>_ 
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(v) tan 2 x = sec 2 x — 1. 

(vi) = 

a+x i + 



(vii) 



1 1/a 



Va 2 -x 2 Vl - (j/*) 2 



, .... 1 1 — sin ^ 1 — sin # 

(viu) - — ■ — : = — — = = sec 2 x — sec x tan x. 

1 + sin x 1 — sin 2 x cos 2 x 

x 8a: 2 + 6* + 4 6 
(ix) — — = 8* -- 2 + 



(x) 



x + 1 * + 1 

1 1 



V2* ~ AT 2 Vl - ( X - l) 2 

2. (i) - cos e x . (Let u = e*.) 
(iii) (log *) 2 /2. (Let u = log x.) 
(v) <? c \ (Let a = e e \) 

(vii) 2^. (Let u = V*.) 

(ix) -(log(cos *)) 2 /2. (Let u = log(cos *).) 

3. (i) J*V = x 2 e z - J2a:^ </* = x 2 e* - [2xe x - fe x dx] 

= x 2 e x - 2*** + 2e x . 
(iii) We have 

f ar . , , sin £a: 6 /" 

/ e ax sin 6a 1 afr = / e x cos bx dx 

J a a J 

e ax sin bx b [e ax cos bx b [ ] 
= / e ax (- sin bx)dx L 



so 



y e ax sin bx dx ^ 0 " yo c> az sin 6* - 0 " , „ 6> ax cos £a\ 



^2 + £2" - a 2 + b 2 * 



(v) Using the result /(log *) 2 <fe = a: (log a:) 2 — 2a: (log x) + 2x from 
the text, we have 

j (log x) z dx= [*(log x) 2 - 2*(log *) + 2x]\og x 

- y ~ [x(log x) 2 - 2*ftog *) + 2*] & 

= A:(log x) 3 - 2x(\og x) 2 + 2x log x 

- J (log x) 2 dx + 2[x log x - x] - 2x 

= *(log a:) 3 — 2A*(log x) 2 + 2x log a: 

- [>(log x) 2 - 2A*(log *) + 2x] + 2[* log x - x] - 2x 
= *(log a*) 3 — 3*(log a-) 2 + 6a: log a* — 6a*. 



(vii) J* sec 3 x dx = /(see 2 a:) (sec x) dx = tan x sec # 

— / (tan #) (sec x tan #) 
= tan x sec # — J sec x(sec 2 # — 1) <£* 
= tan a; sec x — J sec 3 # dx + / sec * cfc, 

so 

J sec 3 x dx = %\tan~x sec * + log(sec x + tan *)]. 

//- 2a: 37 2 2 f 1 

V a: log x dx = — — log x — - / * 3/2 * - dx 
3 3 J x 

= — log x - - / * 1/2 

= — log * - ^ * 3/2 - 

4. (i) Let x = sin w, = cos w du. The integral becomes 

/cos u du f . . 

- . = = / 1 du = u = arcsin *. 
VI - sin 2 w 7 

(iii) Let # = sec w, <Z* = sec u tan w du. The integral becomes 

/sec u tan u du f . . , . . >. 

— — = / sec a du = log(sec w + tan a) 

Vsec 2 H-l 7 

= log(* + Vx 2 - 1). 
(v) Let * = sin u, dx = cos w du. The integral becomes 

CQ S = ~ = = f esc u du — — log(csc u + cot u) 

sin w VI — sin 2 u J 

__ log (i + ^IIi). 

\X X / 

(vii) Let x = sin u, dx — cos w du. The integral becomes 

J (sin 3 u cos w)cos u du = J sin 3 a cos 2 u du = J (sin a) (1 — cos 2 m)cos 2 u du 

f , . w o ^ v . cos 3 a , cos 5 u 
= / (sin u) (cos 2 w — cos* u)du = 1 — 

(1 - x 2 ) 3 ' 2 (1 - * 2 ) 5 ' 2 

3 5* 

(ix) Let x = tan u y dx = sec 2 u du. The integral becomes 

J sec w sec 2 udu — f sec 3 w <fo 

= ^[tan w sec w + log (sec u + t an n)] by Problem 3 (vii) 

= ±[x VTT7 2 + log(* + Vl + * 2 )]. 
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5. (i) Let u = V x + 1, x = u* - 1, dx = 2u du. The integral becomes 

= 2u - 2 log(l + U )=2V, + l- 2 log(l + Vx + 1). 
(iii) Let u = * 1/6 , x = u 6 , dx = 6w 5 du. The integral becomes 
f 6u 5 du , f / a 1 \ 

J^+^ = 6 J ( u2 ~ u + 1 -^r 1 )du = 2u^3u^ + 6u-6log(u+l) 
= 2^-3^ + 6^-6 log(\^ + 1). 

(v) Let w = tan x } x — arc tan a, </* = </w/(l + u 2 ). The integral 
becomes 

f du _ 1 r/_i «-2 \ 

7 (1 + « 2 )(2 + u) Sj\2 + u 1 + «y " 

= 1 f du JL ( 2u d + 2 f — 

5 7 2 + « 10 7 1 + a 2 5 7 1 + a 2 

112 
= - log(2 + w) - — log(l + w 2 ) + - arctan a 
d 10 5 

= ^log(2 + tan x) - ^ log(l + tan 2 *) + | *. 

(vii) Let u = 2 X , x = (log a) /(log 2), dx = <fc/( M log 2). The integral 
becomes 

1 f u* + 1 1 r/ 1 - g \ 

log 2 7 («+l)« " log2 7 V * 

log 2 7 V a « + 1/ 
= ^ + log u " 2 log( " + 1)] 
1 [2- + * log 2 - 21og(2* + 1)]. 



log 2 

(ix) Let u = V#, x — u 2 , dx — 2u. The integral becomes 

Vl - w 2 2w «/ M 



r vi - u 2 2x 

J 1 — w 



Now let u = sin^, du = cosy dy. The integral becomes 

/ 2 cos y sin y cosy . _ f (1 — sin 2 y)sin y , 
~ — ~ dy = 2 ^— f J - dy 
1 — sin y J 1 — sin y 

= 2 j (1 + sinjy)sin^ </y 

= 2 y* sin </y + ^ 1 — cos 2y dy 



sin 2y . 
= —2 cosjy +jy ^ = — 2 cos;; +y — sin^cos.y 



= — 2 Vl - u 2 + arcsin u — u Vl — w 2 



= -2 Vl - x + arcsin V* - V* V 1 - x. 



The substitution a = Vl - *, * = 1 - u 2 , dx = —2k <fa leads to 
-2m 2 du 



VT 



and the substitution u — sin ^ then leads to 

/— 2 sin 2 y cos y </v . . 
= — 2 sin y — y — sin y cos y 
1 — cosjy 

= —2u — arcsin u — u Vl — u 2 

= -2 Vl - x - arcsin Vl - x - Vl - x V*. 

These answers agree, since 



arcsin V* — — — arcsin Vl — x 



(check this by comparing their derivatives and their values for 
x = 0). 

6. In these problems / will denote the original integral, 
(i) 



= 2 log(* - 1) - 



x + 1 



(iii) 



_4_ 

( x -iy~"" J (x + iy 

1_ 2 

(* - 1) (* + l) 2 " 
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(v) 

/= 1 f-^-dx + f-^—dx 

2 J x 2 + 1 T ; ,* + 1 

= ilog(* 2 + 1) + 4 arctan *. 

(vii) 

Now 



f x* + x +i dx J ( X + i; 



I / FT- 



4 V3 
3' 2 



-~ (&(• + !)) 



so 



/ = log(* + 1) + log(* 2 + x + 1) - arctan (x + i)). 

(ix) 

/= /" 2 * + 1 j _ [ 1 

y (^+x + d 2 * j (* 2 +* + 1) 2 * 

/ 2a: + 1 _ 16 /* 1 



Now the substitution 

V3 



2 



changes the second integral to 

16 VI f __du_ 
9 ' 2 J (u 2 + l) 2 ' 
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Using the reduction formula, this can be written 

[ * + 1 f _*L- 1 = - ^ [ l0 ^ 2 + 1 ) + 1 arctan J, 
9 L2(w 2 + 1) 2 7 w 2 + 1J 9 L 4 2 J 



= _ 1 _ 2 V3 
* 2 + * + 1 9 



log Q(* 2 + *+ 1)) 



4 V3 / 2 A , 1\\ 

arctan I [ (x + - ) J. 

9 W3 V 2// 



1 1 . The equation J> sin x dx = e z sin a: — e x cos # — JV sin x dx means 
that any function F with = f sin # can be written Fix) = ^ sin x — 

e x cos x - G(x) where G is another function with G'O) = e x sin *. Of 
course, G = F + c for some number but it is not necessarily true that 
F = G. 



12. (a) 



j arcsin x dx = J 1 • arcsin x dx — x arcsin x — J 



. dx 



= x arcsin x + Vl — x 2 . 



13. (a) 

/sin 3 cos x 3 /* 
sin 4 x dx = h - / sin 2 x dx 

sin 3 x cos * , 3 f sin # cos # , 1 /* . , 1 
= -—4— + + 2i 1A J 



sin 3 a" cos # 3 sin x cos # . 3 
— x. 

4 8 8 



sin 4#~l 
2 8 J 



x sin 2x . 1 f 1 + cos 4# 
— ^_ _ / fa 

4 4 4 J 2 

* sin 2* 1 Yx , sin 4#~ 

4 4~ 4 L2 

3a: sin 2x sin 4# 

"8 4~~ 32 



(b) It follows that these two answers are the same, since they have the 
same value for x = 0. 
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17. (a) 

sin n x dx — /(sin ^(sin*"" 1 x) dx 

— — cos x sin 71-1 x + (n — l)/(cos a*) (sin 71-2 a:) (cos x) dx 
= — cos x sin 7 ^ 1 a: + (n — 1)/ (sin n ~ 2 x — sin n a:) ak, 

so 

/sin 71 x dx = — - cos * sin 71 " 1 a: + f sin 7 * -2 a: dx. 

n n J 

(b) 

J cos n x dx — /(cos x)(cos n_1 a:) dx 

— sin x cos 71-1 x + (n — 1)/ sin #(cos n ~" 2 a*) sin x dx 
= sin x cos 71 " 1 x + (n — l)J(cos n ~ 2 x — cos n x) dx, 

so 

/cos n x dx = - sin a* cos 71-1 a* + f cos n ~ 2 x dx. 

n n J 

(c) 

/dx [ dx fx 2 dx 

(i + xy " j (i + a* 2 )^ 1 " y (i + x 2 ) w 

« f dx [ * d 

y (i + a- 2 )- 1 y * ■ (i + xt x 

/dx I" a: 

(1 + A* 2 )*" 1 ~ L2(l - «)(1 ~h A" 2 ) 71 " -1 

- f * 1 

7 2(1 - n)(l + a: 2 ) w ^J 



so 



r dx 1 a: _ (2w - 3) /* 1 

y (1 + * 2 ) n 2(» - 1) (a: 2 + l) 71 ' 1 2(n - 1) y (a: 2 + l) 71 " 1 

We can also use the substitution x = tan a, ^a- = sec 2 w du, which 
changes the integral to 

/sec 2 u du f 
sec 271 u J 



cos 271 2 u du 



cos 271 3 u sin a + — f cos 271 4 u du 

~ -2 J 



2n - 2 2w 

1 1 x 2n - 3 f dx 

In - 2 ' (Vi~+V 2 ) 2n - Z ' Vr+T 2 2n - 2 y (1 + a- 2 ) 71 " 1 

1 x 2k — 3 f dx 

2{n - 1) (1 + * 2 ) n_1 2n - 2 J (1 + a* 2 ) 71 - 1 ' 
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CHAPTER 19 1. (i) p 3i0 ( x ) = e + ex + ex 2 + (5e/3\)x\ 

<P2n.iT/2M = 1 — - 
(-\) n (x - tt/2) 2w 



(2n)\ 

(v) Pn,i(x) = e + e(x - 1) H — f- • • • H ■ 

2! n\ 

(vii) P4,oW = at + x 3 . 

(ix) A H ,,oW = 1 - * 2 + * 4 - • • • + (-i)V. 
2. If /is a polynomial function of degree n, then / ( * +1) = 0. It follows from 
Taylor's Theorem that R„, a (x) = 0, so f(x) = P n , a (x). 
(i) -12 + 2(* - 3) + (x - 3) 2 . 

(iii) 243 + 405(x - 3) + 270(x - 3) 2 + 90(* - 3) 3 + 15(* - 3) 4 
+ (x - 3) 5 . 



3 - W t(2^X SinCe (27^ <10 " 17f ° r2 " + 2 ^ 9 '° r ^ 9 ) 

t' = 0 

(iii) Y J"" 1 -*' - (since — - — < 1CT 20 for 2n + 2 > 18, 

V 1 L(2>(2i+ 1)! V 2 2re+2 (2« + 2) ! 

1 = 0 

or n > 8^ 

11 

- (since < 10~ 5 for n + 1 > 12, or n > 11 ). 

i\ \ (n + 1) ! / 

i = 0 

7. (i) a = ai + 

(iii) a = (t + \)cn. 

(v) = f(t) dt; a = a t -_iA for i > 0. 



chapter 21 i. (i) i - n / (n + 1 ) = i /( w + 1) < e for n + 1 > 1/e. 

(iii) lim vV + 1 - + 1 = lim (Vn 2 + 1 - V^) + lim (V 7 /? 

n — ► w n — ► oo n — ► » 

— V / w + l)=0 + 0 = 0. (Each of t hese t wo limits can be 
proved in the same way that lim(V / ?? + i - Vn) = 0 was 

71— » « 

proved in the text.) 
(v) Clearly lim (log a)/n = 0. So lim = lim *< lo *<*>/* = e o ( by 

Theorem 1) = 1. 

(vii) < Vn 2 _+ n < Vw, so (Vn) 2 < Vn 2 + n < Vl (Vn) 2 , 

and lim (Vn) 2 = lim Vl (V n) 2 = 1 by parts (v) and (vi). 

n— * » n-+ °° 

(ix) Clearly a(n) < log 2 n, and lim (log 2 n)/n = 0. 
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4. (a) If 0 < a < 2, then a 2 < 2a < 4, so a < V 2a < 2. 

(b) Part (a) shows that 

V2 < ^2 V2 < "^2 ^2 V2 < - - - < 2, 

so the sequence converges by Theorem 2. 

(c) If this sequence is denoted by {a n \, then the sequence {V / 2a w } is 
the same as {a n +i}. So the hint shows that / = V2/, or / = 2. 

5. If x is rational, then nlirx is a multiple of w for sufficiently large w, so 
(cos n\irx) 2k = 1 for all such n, so lim(lim(cos n\itx) 2k ) = 1. If x is irra- 

n— » 00 k—> 00 

tional, then ti\tx is not a multiple of w for any n, so |cos «!7ta:| < 1, so 

lim(cos n\irx) 2k = 0, so f(x) = 0. 
a— * * 

6. (i) j e x dx — e — \. (Use partitions of [0, 1] into n equal parts.) 

(hi) / — — dx = log 2. 
Jo 1 + * 



Jo (1 + ^ 



1 

a+*) 2 ~" 2' 



CHAPTER 22 1. (i) (Absolutely) convergent, since [(sin nd)/n 2 \ < \/n 2 . 

(iii) Divergent, since the first 2n terms have sum \ + " * * + 1 In. 
(Leibnitz's Theorem does not apply since the terms are not 
decreasing in absolute value.) 
(v) Convergent, since 

1 < A 

for sufficiently large n. 
(vii) Convergent, since 

lim (« + !);/(* + !)! . Hm (n_±AV . _ Q 

n-* « \ 72 / 



/Z 2 /tt! n-*» \ ft / n + 1 

(ix) Divergent, since l/(log rc) > 
(xi) Convergent, since l/(log n) n < ^ for « > 9. 
(xiii) Divergent, since 

n 2 1 
> 



« 3 + 1 2n 

for large enough n. 
(xv) Divergent, since 



L 



3 a: log x 



dx = log(log AO — log(log 3) — * oo as N— > oo. 
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(Notice that /(*) = l/(x log x) is decreasing on [3, oo), since 

m - ~ [1 , + lo t x] < 0 iorx>e - 

(x log X) 2 

(xvii) Convergent, since l/rc 2 (log n) < 1/n 2 for n > 2. 
(xix) Convergent, since 

lim 2n+l ( n + + 1)n " 1 " 1 = lim 2{jl + l)nU 

n™ 2 n «!/fl n n™ (« + l) n+1 

r 2 2 
= lim = -j 



by Problem 17-12. 
4. (a) For each N we clearly have 



0 < 2 ^10" n < 9 ^ lCT n = 1, 

n = 1 n = 1 

so ^ a n 10~ n converges by the boundedness criterion, and lies 

n = l 

between 0 and 1. (Actually, this number is denoted by 0.aifl2«3«4 • • . 
only when the sequence {a n } is not eventually 0.) 
15. The area of the shaded region is The integral is 

w - « + a - « + tf* - ttV] + •••)- m - 1] + » - tVi + • • •) 

= i(* + i + A + + • • •) - Ui + + + + • • •) 
= i(i + 1 + + <nr +•••)- id + i + + + • • 0 



1 1 



8 1-1 



CHAPTER 23 1. (0 

f(x) = lim /nW = ( °> * " ° , 

n-> « 11, 0 < X < 1 . 



{/ n } does not converge uniformly to /. 
(iii) /(*) = lim f n {x) = 0 (since lim x n = oo for * > 1). The se- 

n— ► oo n— > oo 

quence {/„} does not converge uniformly to /; in fact, for any n 
we have /„(*) large for sufficiently large x. 
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( v ) /(*) = lim f n (x) = 0, and {f n } converges uniformly to /, since 
!/»(*) I < 1/n for all *. 

2. (i) - 1 - X - - X - . 

a a 2 a z 



(iii) 

k = 0 



3. (i) e~* 
(iii) If 



y Z Y A y.'k 

yw 2 3-2 4-3 ' 11 



then 

= log(l+*) |*|<1, 

so for |*| < 1 we have f(x) = (1 + *)log(l + x) - (1 + x) + c 
for some number c. Since /(0) = 0, we have c = 1, so f(x) = 
(1 + *)log(l + x) - x for \x\ < 1. 

4. Since 



sin * = > — - 



■o 

n = 0 

we have 

(-l) n x 2n 



+ 1)! 

n = 0 

(notice that the right side is 1 for x — 0). So 

I(-l) n _ 
(STi)? k = 2n 
0, A; odd. 



chapter 24 1. (i) |3 + Ai\ = 5; 0 = arctan 

(iii) |(1 + 0 5 | = (|1 + *1) 5 = 1; since tt/4 = arctan 1/1 is an argu- 
ment for 1 + i, an argument for (1 + i) b is 57r/4. 
(v) |(|3 + 4t|)| = |5| = 5; 6 = 0. 
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2. (i) 



X — 



-i ± V-l - 4 

-i ± Vb i 

_ 

(-1 + Vs)i (-1 - Vl)i 

or ^— — L. 



(iii) x 2 + 2ix — 1 = (x + z') 2 , so the only solution is x = —i. 
(v) x s - x 2 - x - 2 = (* - 2)(x 2 + x + 1). The solutions are 

2 - 1 • 1 ^ ■ 

' 2 2 2 2 '* 

3. (i) All z = iy with real. 

(iii) All z on the perpendicular bisector of the line segment between 
a and b. 

(v) No z, since |# + z'jy ] < 1 — x implies that x > 1, and that 
a- 2 + j> 2 < 1 — 2x + x 2 , so jv 2 < 1 — 2^-, which is impossible, 
since 1 — 2x < 0 for x > 1. 

4. [a- + ry| = * 2 + y 2 = x 2 + ( — y) 2 = \x — iy\. 
(z + z)/2 = [(x + z» + 0 - z»]/2 = *. 

(* - z)/2 = [(* + i» - (* - iy)yii = y. 

5. \z + w\ 2 + \z — w\ 2 = (z + w)(z + fi?) + (* — w) (z — w) = 2zz + 
2^w = 2(|z| 2 + \w\ 2 ). Geometrically, this says that the sum of the 
squares of the diagonals of a parallelogram equal the sum of the squares 
of the sides. 



CHAPTER 26 1. (i) Converges absolutely, since |(1 + i) n /n\\ < (V2) n /n\, and 

00 

V (V2)»/„! converges, 
(iii) Converges, but not absolutely, since the real terms form the series 

~i + i ~ i + I" — * ' ' • 
and the imaginary terms form the series 

«•(*-* + *- + +•••). 

(v) Diverges, since the real terms form the series 

log 3 log 4 log 5 log 7 log 8 log 9 
3 4 5 7 8 9 
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2. (i) The limit 

\z\ n+x /{n + l) 2 (n + IV, , , , 

lim / ; = hm f ) \z\ = \z\ 

n-> • \z\ n /n 2 n->« \ n / 

is <1 for |*| < 1, but >1 for \z\ > 1. 
(iii) The limit 

is <1 for |*| < 1 but >1 for \z\ > 1. 
(v) The limit 

on+l| J(n+l)l 

lim - 7 1 , , = lim 2\z\^~* 

n-- 2 n \z\ nl *r+* 

is 0 for |*| < 1, but °o for |*| > 1. 

3. (i) The limits 



2n 

lim 



fcC- W and h *"Ej 
f 3* a/3 V 2 n+1 V2 



are <1 for |*| < V2, so the series converges absolutely for 
|*| < y/l. But the series does not converge absolutely for 

11^ . 1 i • r • -v / O 



|*| > V2, so the radius of convergence is 
(iii) Since 



lim >_M: = lim !£!i5 <„„!£! = », 

n— > * \ 72 n n-> « 72 n— ► <» 71 

the series converges absolutely for all 2, so the radius of con- 



vergence is oo 
(v) The limit 



lim V / 2 n * n! = 2 lim * (n " 1)! 

n— ► oo n— * oo 

is 0 for |*| < 1, but oo for |*| > 1 , so the radius of convergence is 1. 
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Absolutely summable, 397 
Acceleration, 137 
Acta Eruditorum, 124 
Addition, 3 

associative law for, 9 

commutative law of, 9 

of complex numbers, 438 

geometric interpretation of, 442 
Addition formula 

for arcsin, 270 

for arctan, 270 

for cos, 266 

for sin, 265, 266 

for tan, 269 
Additive identity, existence of, 9 
Additive inverses, existence of, 9 
Algebra, Fundamental Theorem of, 

317, 445, 455, 474 
Algebraic functions, 302 
Algebraic number, 362 
Algebraist's real numbers, 505 
Almost lower bound, 120 
Almost upper bound, 120 
Analyst's real numbers, 505 
Angle, 256 

directed, 256 
Antidiagonal, 213 

Arabic numerals, multiplication of, 8 
Arc length, 275 
Arccos, 264 

Archimedes, 116, 119, 224 
Archimedian property 

for the rational numbers, 490 

for the real numbers, 116 
Arcsec, 272, 322 
Arcsin, 263 

addition formula for, 270 

derivative of, 264 

Taylor series for, 429 
577 



Arctan, 264 

addition formula for, 270 

derivative of, 264 

Taylor polynomials for, 335, 342 
remainder term for, 351 
Area, 214, 219 
Arg cosh, 296 
Arg sinh, 296 
Arg tanh, 296 
Argument, 443 
Argument function, 449 

discontinuities of, 453 
Argument of the hyperbolic functions, 
296 

Arithmetic mean, 32 
Arrow, "x arrow sin (a: 2 )," 43 
Ars conjectandi, 481 
Associative law 

for addition, 9 

for multiplication, 9 
Average velocity, 128 
Axis 

horizontal, 55 

imaginary, 441 

real, 441 

vertical, 55 



Bacon, Francis, vi 

Bandes, D., handiwork of, 

Basic properties of numbers, 3 

"Bent" graphs, 125 

Bernoulli, 124, 481 

Bernoulli numbers, 478 

Bernoulli polynomials, 481 

Bernoulli's inequality, 31 

Big game hunting, mathematical theory 

of, 459 
Binary operation, 487 
Binomial coefficient, 27, 357 
Binomial series, 409, 429 
Binomial theorem, 28 
Bisection argument, 120, 459 
Bohr, Harald, 328 
Bolzano- Weierstrass Theorem, 378, 

386, 459 
Bound 

almost lower, 120 



Bound (Cont.) 

almost upper, 120 

greatest lower, 112 

least upper, 111, 490 

lower, 112 

upper, 111, 490 
Bounded above, 100, 111, 377, 490 
Bounded below, 112, 377 
Bourbaki, Nicholas, 124 



Cauchy, 239 

Cauchy Condensation Theorem, 410 
Cauchy criterion, 390 
Cauchy form of the remainder, 345, 
347 

Cauchy Mean Value Theorem, 178 
Cauchy sequence, 379, 477 
Cauchy sequences, equivalence of, 505 
Cauchy-Hadamard formula, 476 
Cauchy-Schwartz inequality, 239 
Cesaro summable, 408 
Chain Rule, 150 ff. 

proof of, 154 
Change, rate of, 128 
Characteristic (of a field), 492 
Circle, 63 

"/ circle 42 

unit, 64 
Circle of convergence, 466 
Classical notation 

for derivatives, 130-131, 138, 142- 
143, 162, 212 

for integrals, 225 
Cleio, 161 
Closed interval, 55 
Closed rectangle, 454 
Closure under addition, 9 
Closure under multiplication, 9 
Commutative law 

for addition, 9 

for multiplication, 9 
Comparison test, 391, 407 
Comparison Theorem, Sturm, 275 
Complete induction, 23 
Complete ordered field, 490, 509 
Completing the square, 18, 318 
Complex analysis, 473 



Complex function 

continuous, 453 

differentiable, 457 

graph of, 449 

limit of, 449 

nondifferentiable, 458 

Taylor series for, 469 
Complex nth. root, 443 
Complex numbers, 433, 438 

absolute value of, 441 

addition of, 438 

geometric interpretation of, 442 

geometric interpretation of, 442 

imaginary part of, 438 

logarithm of, 477 

modulus of, 441 

multiplication of, 438 

geometric interpretation of, 442- 
443 

real part of, 438 

sequence of, 462 
Complex plane, 440 
Complex power series, 464 

circle of convergence of, 466 

radius of convergence of, 466 
Complex sequences, 462-463 
Complex series, 463 
Complex-valued functions, 448 
Composition of functions, 42 
Concave function, 192 
Conditionally convergent series, 398 
Conjugate, 441, 446 
Constant function, 41 
Construction of the real numbers, 494 
Continuous at a, 93, 452 
Continuous function, 93, 453 

nowhere differentiable, 135, 422 
Continuous on (a, b), 96 
Continuous on [a, b], 96 
Contraction, 384 
Contraction lemma, 385 
Converge 

pointwise, 415 

uniformly, 415, 419 
Convergent sequence, 373, 462 
Convergent series, 389, 463 

absolutely, 397, 463 

conditionally, 398 
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Convex function, 191 

Convex hull, 460 

Convex subset of the plane, 460 

Cooling, Newton's law of, 298 

Coordinate 

first, 55 

second, 55 
Coordinate system, 55 

origin of, 55 
"Corner," 58 

Cos, 256, 259, 273-274, 276, 470 

addition formula for, 266 

derivative of, 148, 260 

inverse of, see Arccos 

Taylor polynomials for, 334 
remainder term for, 348 
Cosh, 296 

Cosine, hyperbolic, 296 
Cot, 263 
Countable, 369 
Counting numbers, 21 
Critical point, 165 
Critical value, 165 
Csc, 263 

Cubic equation, general solution, 435 



Darboux's Theorem, 187, 242, 253 
Decimal expansion, 70, 407 
Decreasing function, 170 
Dedekind, Richard, 36 
Defined implicitly, 211 
Definite integral, 304 
DEFINITION, 45 
Definition, recursive, 33 
Degree (of a polynomial), 40 
Degree measurements, 61, 257-258 
Delicate ratio test, 408 
Delicate root test, 408 
De Moivre's Theorem, 443 
Dense, 118 

Derivative, 125 ff., 127 

classical notation for, 130-131, 138, 

142-143, 162, 212 
of/, 127 
of/ at a, 127 
higher-order, 137 
"infinite," 134 



Deritative, left-hand, 132 

Leibniz ian notation for, see Deriva- 
tive, classical notation for 
"negative infinity," 134 
right-hand, 132 
second, 137 
Derivative of quotient, incantation for, 
147 

Diagonal, 202 
Difference operator, 479 
DifTerentiable, 127, 457 
Differential equation, 247, 253, 273, 
275, 301. 359 

initial conditions for, 360 
Differentiation, 144 ff. 

implicit, 211 
Differentiation operator, 479 
Directed angle, 256 
Discontinuities of a nondecreasing 

function, 370 
Discontinuity, removable, 99 
Disraeli, Benjamin, 2 
Distance, 56, 441 

shortest between two points, 276 
Distributive law, 9 
Diverge, 373, 463 
Division, 6 
Division by zero, 6 
Domain, 38, 39, 45, 507 
Double intersection, 141 
Double root, 160 
Durege, 36 



e 9 287 

irrationality of, 353 

relation with 7r, 368, 471 

transcendentality of, 364 

value of, 288, 350 
Elementary function, 302 
Ellipse, 64 

Empty collection, 23 
Entire function, 474 
Epsilon, 19 

Equal up to order n, 340 
Equality, order of, 340 
Equations, differential, see Differential 
equations 



Equivalent Cauchy sequences, 505 
Euler, 481 

Euler-Maclaurin Summation Formula, 
482 

Euler's number, 382 
Even function, 49, 174 
Even number, 25 
Eventually inside, 462 
Exhaustion, method of, 119 
Exp, 287 ff., 470 

Taylor polynomials for, 335 
remainder term for, 349-350 
Expansion, decimal, 70, 407 
Extension of a function, 93 

Factorial, 23 
Factorials, table of, 356 
Factorization into primes, 31 
Fibonacci, 31 
Fibonacci Association, 32 
Fibonacci Quarterly, The, 32 
Fibonacci sequence, 31, 430, 478 
Field, 487 

characteristic of, 492 
complete ordered, 490, 509 
ordered, 489 
First coordinate, 55 
First Fundamental Theorem of Calcu- 
lus, 240 

First Mean Value Theorem for Inte- 
grals, 237 
Fixed point of a function, 384 
Fourier series, 270, 272 
Function, 37, 45 

from A to B, 507 

absolute value, 448 

argument, 449, 453 

complex- valued, 448 

composition of, 42 

concave, 192 

conjugate, 448 

constant, 41 

continuous, 93 ff. 

convex, 191 

critical point of, 1 65 

critical value of, 165 

decreasing, 170 



Function, derivative of, 125 ff. 
differentiate, 127 
elementary, 203 
entire, 474 
even, 49, 174 
exponential, 287-288 
extension of, 93 
fixed point of, 384 
graphs of, 54-63, 173, 449 
hyperbolic, 296 
identity, 41 
imaginary part, 448 
increasing, 170 
integrable, 219 
integral of, 219 
inverse, 201 ff. 
linear, 56 

local maximum point of, 164 
local minimum point of, 164 
local strict maximum point of, 190 

logarithm, 285, 289 

maximum point of, 163 

maximum value of, 1 63 

minimum value of, 163 

most general definition of, 507 

negative part of, 49 

nondecreasing, 213 

nonincreasing, 213 

nonnegative, 49 

notation for, 43 

odd, 49, 174 

periodic, 69, 140, 252 

polynomial, 40 

positive part of, 49 

power, 58 

product of, 41 
quotient of, 41 
rational, 40 
real part, 448 
real-valued, 448 
"reasonable," 96, 125, 156 
regulated, 431 
step, 235 

strict maximum point of, 190 
sum of, 41 

trigonometric, 256 ff. 
value of at x, 38 
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Fundamental Theorem of Algebra, 317, 

445, 455, 474 
Fundamental Theorem of Calculus 

First, 240 

Second, 244 

Galileo, 124, 140 
Gamma function, 327, 364 
Geometric mean, 32 
Geometric series, 390 
Global properties, 101 
Goes to, "x goes to sin(x 2 )," 43 
Graph sketching, 171-176 
Graphs, 54-63, 72-73, 173, 449 
Greatest lower bound, 112 
Grow faster than, 292, 301 

Hadamard, 476 

Half-life (of radioactive substance), 298 
Hermite, 363 

High-school student's real numbers, 505 
Higher-order derivatives, 137 
Hilbert, 363 
Horizontal axis, 55 
Hyperbola, 65 
Hyperbolic functions, 296 

Identity 

additive, 9 

multiplicative, 9 
Identity function, 41 
Identity operator, 480 
Imaginary axis, 441 
Imaginary part of complex number, 
438 

Imaginary part function, 448 
Implicit differentiation, 211 
Implicitly denned, 211 
Improper integral, 254, 329 
Incantation for derivative of quotient, 

147 ■ 
Increasing at a, 189 
Increasing function, 170 
Increasing /sequence, 377 
Indefinite integral, 304 



Indefinite integrals, short table of, 304- 

305 

Induction, mathematical, 21 

complete, 23 
Inductive set of real numbers, 33 
Inequalities, 9 

in an ordered field, 490 
Inequality 

Bernoulli's, 31 

Gauchy-Schwartz, 239 

geometric-arithmetic mean, 32 

Jensen's, 199 

Liouville's, 369 

Schwartz, 18, 239 

triangle, 68 
Infimum, 112 
"Infinite" derivative, 134 
Infinite intervals, 55 
Infinite products, 282, 328 
Infinite sequence, 372, 462 
Infinite series, 389 
Infinite sum, 354, 388 
Infinitely many primes, 31 
"Infinitely small," 131, 225 
Infinity, 55 

minus, 55 
Inflection point, 197 
Initial conditions in differential equa- 
tions, 360 
Instantaneous speed, 128 
Instantaneous velocity, 128 
Integer, 25 
Integrable, 219 
Integral, 219 
classical notation for, 225, 226 
definite, 304 

First Mean Value Theorem for, 237 
improper, 254-255, 329 
indefinite, 304 

short table of, 304-305 
Leibnizian notation for, see Integral, 

classical notation for 
lower, 249 

Second Mean Value Theorem for, 
237 

Third Mean Value Theorem for, 237 
upper, 249 



Integral form of the remainder, 345, 
346 

Integral sign, 219 
Integral test, 396 
Integration 

limits of, 219 

by parts, 305 ff. 

of rational functions, 316 

by substitution, 307 fT. 
Interest (finance), 298 
Intermediate Value Theorem, 102, 109, 

113, 253 
Interpolation, Lagrange, 47 
Intersection of sets, 41 
Interval, 54 

closed, 55 

infinite, 55 

open, 54 

see also Nested Intervals Theorem 
Inverse 

additive, 9 

multiplicative, 9 
Inverse of a function, 201 ff. 
Inverses of trigonometric functions, see 

Trigonometric functions 
Irrational numbers, 25 
Isomorphic fields, 508 
Isomorphism, 508 

Jensen's inequality, 199 
Johnson, Samuel, 514 
Jump, 58 

Klingenstein, K., trials and tribulations 
of, 

Lagrange form of the remainder, 345, 
347 

Lagrange interpolation formula, 47 
Large negative, 62 
Least upper bound, 111 ff., 490 
Least upper bound property, 113 
Lebesgue, see Riemann-Lebesgue 

Lemma 
Left-hand derivative, 132 



Leibniz, 124, 131, 225 
Leibnizian notation for derivatives, 131, 
142-143, 162, 212 
for higher-order derivatives, 138 
Leibniz's formula, 159 
Leibniz's Theorem, 398 
Lemma, 82 
Length, 275 

L'Hopital, Marquis de, 124 
L'Hopital's Rule, 179, 186-187 
Limit, 72 ff., 78, 449 

from above, 86 

from below, 86 

"does not exist," 81 

at infinity, 87 

of integration, 219 

of a sequence, 373 

uniqueness of, 80 
Limit point, 386, 459 
Limit superior, 121, 385 
Lindemann, 367 
Line, real, 54 

Line, tangent, see Tangent line 

Linear functions, 56 

Liouville, 368 

Liouville's inequality, 369 

Liouville' s Theorem, 474 

Local maximum point of function, 164 

higher-order derivative test for, 339 

second derivative test for, 176 
Local minimum point of function, 164, 

see also Local maximum point 
Local property, 89, 101, 142 
Local strict maximum point, 190 
Log, 285 

Taylor polynomials for, 335 
remainder term for, 351 
Logarithm 

to the base 10, 283 

of a complex number, 477 

Napierian, 299 
Lower bound, 112 

almost, 120 

greatest, 112 
Lower integral, 249 
Lower limit of integration, 219 
Lower sum, 215 
Lowest terms, 71 
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Maclaurin, 482 
Mass, rate of change of, 128 
Mathematical induction, 21 
Maximum point of a function, 163 

local, 164, see also Local maximum 
point 

local strict, 190 

strict, 190 
Maximum of two numbers, 16 
Maximum value of function, 163 
Mean, arithmetic, 32 

geometric, 32 
Mean Value Theorem, 168, 169 

Cauchy, 178 

for integrals (First, Second, and 
Third), 237 
Method of exhaustion, 119 
Minimum of function, 163 
Minimum point of a function, local, 

1 64, see also Local minimum point 
Minimum of two numbers, 16 
Minus infinity, 55 
Mirifici logarithmonum canonis 

description, 299 
Modulus of a complex number, 441 
Mollerup, Johannes, 328 
Multiplication, 5 

of arabic numerals, 8 

associative law for, 9 

closure under, 9 

commutative law of, 9 

of complex numbers, 438 

geometric interpretation, 442-443 
Multiplicative identity, existence of, 9 
Multiplicative inverses, existence of, 9 
Multiplicity (of a root), 108 

Napier, 299 

Napierian Logarithm, 299 

Natural numbers, 21, 33 

Negative, large, 62 

"Negative infinity," derivative, 134 

Negative number, 9 

Negative numbers, product of two, 7 

Negative part of a function, 49 

Nested Intervals Theorem, 120 

Newton, 131, 235 



Newton's law of cooling, 298 
Newton's laws of motion, 137 
Nondecreasing function, 213 
Nondecreasing sequence, 377 
Nondifferentiable complex functions, 
458 

Nonincreasing function, 213 
Nonnegative function, 49 
Nonnegative sequence, 391 
Notational nonsense, 479 
Nowhere-difTerentiable continuous 

function, 422 
nth root, 69, 443 

existence of, 103, 443, 460 

primitive, 447 
Number 

algebraic, 362 

complex, 433, 438 

counting, 21 

even, 25 

imaginary, 433 

irrational, 25 

natural, 25, 33 

odd, 25 

prime, 31 

rational, 25 

real, 25, 441, 495 

transcendental, 362 
Numbers, basic properties of, 3 
Null set, 23 



Odd function, 49, 174 
Odd number, 25 
One-one function, 200 
Open interval, 54 
"Or," 6 

Order of equality, 340 
Ordered field, 489 

complete, 490 
Ordered pair, 45, 52 
Origin (of a coordinate system), 55 



Pair, 44 

ordered, 45, 52 
Parabola, 58 

area under, 224 



Partial fraction decomposition, 317 

Partial sums, 388 

Partition, 215 

Pascal's triangle, 27 

"Peak," 59 

Peak point, 378 

Period of a function, 69, 140, 252 
Periodic function, 69, 140, 252 
Perpendicularity of lines, 68 
Petard, H., 459 
Pig, yellow, v, 314 
Pigheaded, 161 
Plane, 56 

complex, 440 
Point, 54 

Point of contact, 192 
Point-slope form of equation of a line, 
57, 68 

Polynomial function, 40 
graph of, 58-59, 173 
multiplicity of roots, 108, 160 
Polynomials, Bernoulli, 481 
Polynomials, Taylor, 334 ff., see also 

specific functions 
Position, rate of change of, 128 
Positive elements of an ordered field, 
489 

Positive element of R, 500 

Positive part of a function, 49 

Positive number, 9 

Power functions, 58 

Power series, complex, 464 

Power series centered at <z, 423, 471 

Power series representation, uniqueness 

of, 430 
Powers of 2, table of, 356 
Prime number, 31 

characteristic of a field, 492 

infinitely many of, 31 

unique factorization into, 31 
Primitive, 302 
Primitive nth. root, 447 
Principia, 235 
Product, 5 

of functions, 41 

of two negative numbers, 7 
Pythagorean theorem, 25, 56 



7T, 258 

Archimedes's approximation of, 119 
irrationality of, 279 
relation to e, All 
transcendental ity of, 368 
value of, 357 

Vieta's product for 2/x, 282 
Wallis's product for tt/2, 328 



Quaternions, 493 
Quotient of functions, 41 

Rabbits, growth of population, 32 
Radian measure, 61, 257-258 
Radioactive decay, 298 
Radius of convergence of complex 

power series, 466 
Rate of change of mass, 128 
Rate of change of position, 128 
Ratio test, 393 

delicate, 408 
Rational functions, 40 

integration of, 316 
Rational numbers, 25 
Real axis, 441 
Real line, 54 

Real number (formal definition), 495 
Real numbers, 25 

algebraist's, 505 

analysist's, 505 

Archimedian property of, 116, 490 

construction of, 494 ff. 

high-school student's, 505 

inductive set of, 505 
Real part of a complex number, 438 
Real part function, 448 
Real-valued function, 448 
Rearrangement of a sequence, 400 
"Reasonable" function, 66, 96, 125, 156 
Rectangle, closed, 454 
Recursive definition, 23 
Reduction formulas, 316 
Regulated function, 431 
Remainder term for Taylor poly- 
nomials, 343 
Removable discontinuity, 99 
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Riemann-Lebesgue lemma, 272, 327 
Right-hand derivative, 132 
Rising Sun Lemma, 121 
Rolle, 161 

Roile's Theorem, 168 

Root of a polynomial function, 48 

double, 160 

multiplicity of, 108 

see also nth. roots 
Root test, 408 

delicate, 408 



Same sign, 12 

Schwartz, H. A., 18, 190, 239 
Schwartz inequality, 18, 239 
Sec, 263 

inverse of, see Arcsec 
Secant line, 126 
Second coordinate, 55 
Second derivative, 137 
Second derivative test for maxima and 

minima, 176 
Second Fundamental Theorem of Cal- 
culus, 244 
Second Mean Value Theorem for inte- 
grals, 237 
Sequence 

absolutely summable, 397 
Cauchy, 379, 505 
complex, 477 
equivalence of, 505 
of complex numbers, 462 
convergent, 373 
pointwise, 415 
uniformly, 415 
decreasing, 377 
divergent, 373 
Fibonacci, 31, 430, 478 
increasing, 377 
infinite, 372 
limit of, 373 
nondecreasing, 377 
nonincreasing, 377 
rearrangement of, 400 
summable, 389 
Series 

absolutely convergent, 397 



Series (Cont.) 

conditionally convergent, 398 

convergent, 389 

Fourier, 270, 272 

geometric, 390 

power, 423, 471 

Taylor, 424 
Set, 22 

empty, 23 
Sets 

intersection of, 41 

notation for, 41-42 
Shadow point, 121 
Sigma, 24 
Sign, 12 

Sin, 41, 256, 259, 273-274, 276, 470 
addition formula for, 266 
derivative of, 148, 260, 272-273 
inverse of, see Arcsin 
Taylor polynomials for, 334 
remainder term for, 348 

Sine, hyperbolic, 296 

Sine function, 41 

Sinh, 296 

Sketching graphs, 171-176 
Skew-field, 493 
Slope of a straight line, 56 
Speed, instantaneous, 128 
Square root, 12, 434 

existence of, 102-103 
Square root in a field, 492 
Square root function, 453 
Squaring the circle, 367 
Step function, 235 
Stirling's formula, 483 
Straight line (analytic definition), 56 

shortest distance between two points, 
276 

slope of, 56 
Strict maximum point, 190 
Sturm Comparison Theorem, 275 
Subsequence, 378 
Substitution, world's sneakiest, 325 
Substitution formula, 308 
Subtraction, 5 
Sum 

finite, 3-4 

of functions, 41 



Sum (Cont.) 

infinite, 354, 388 

of an infinite sequence, 389 

of an infinite sequence of complex 
numbers, 462 

lower, 215 

partial, 388 

sigma notation for, 24 

upper, 215 
Sum of squares, 459 
Summable, 389, 463 

Abel, 431 

absolutely, 397 

Cesaro, 408 

uniformly, 419 
Supremum, 112 
Swift, Jonathan, 486 
Symmetry in graphs, 174 

Tan, 263 

inverse of, see Arctan 

Taylor series for, 497 
Tangent, hyperbolic, 296 
Tangent line, 125, 127 

point of contact of, 192 
"Tangent line," vertical, 134 
Tanh, 296 

Taylor polynomial, 334 

remainder term of, 343, 345, 346 
Taylor series, 424, 469 
Taylor's Theorem, 345 
Third Mean Value Theorem for inte- 
grals, 237 
Transcendental number, 362 
Triangle inequality, 68 
Trichotomy law, 9 
Trigonometric functions, 256 see also 
Cos, Cot, Csc, Sec, Sin, Tan 
integration of, 315-316 
inverses of, 263 see also Arccos, Arcsec, 
Arcsin, Arctan 



Two-times differentiable, 137 

Uniform limit, 415 

Uniformly convergent sequence, 415 

Uniformly convergent series, 419 

Uniformly distributed sequence, 387 

Uniformly summable, 419 

Uniqueness 

of factorization into primes, 31 

of limits, 80 

of power series representations, 430 
Unit circle, 64 
Upper bound, 111, 490 

almost, 120 

least, 111, 490 
Upper integral, 249 
Upper limit of integration, 219 
Upper sum, 215 



"Valley," 59 

Value, absolute, see Absolute value 
Value of / at x, 38 
Vanishing condition, 390 
Velocity 

average, 128 

instantaneous, 128 
Vertical axis, 55 
Viete, Francois, 282 

Wallis's product, 328 

Weierstrass, see Bolzano- Weierstrass 

Theorem 
Weierstrass M-test, 420 
Well-ordering principle, 23 
Wright, 326 



Zahl, 25 

Zero, division by, 6 



GLOSSARY OF SYMBOLS 



P .9 

w _« 

V* 12 
max (#,;>) 16 
min(*, ^) 16 
e ("epsilon") 19 
N 21 
0 23 
«! 23 

7 a< 24 

Z 25 
Q, 25 
R 25,495 

0 



27 



/(*) 38, 45, 507 
/ 41 

/ + * 41 

4 Pi 5 41 

f-g 41 

//* 41 

c -g 41 

{*: . . .} 41 

{a h . . . , a n ] 42 

/ + £ + A 42 

f-g-h 42 

/«| 42 

f°g°h 43 

x-*f(x) 43 

n 

n *< 47 

a 6 ' 47 
C A 48 

48 

R - A 48 

l/l 49 

max(/, £) 49 
min (/, 5) 49 
f<g 51 
the pair (a, 6) 52 
the open interval (a, 6) 
54 

[a, b] 55 
(«, 00 ) 55 
[a> oo) 55 



(— oo, fl ) 55 
(-oo, a] 55 
(— oo 5 oo ) 55 
M 70 
{*} 70 

5 ("delta") 78 
Km/(x) 81 

lim/ 81 

a 

lim /(a:) 



86 
86 
86 
87 
87 
92 

lim f(x) = oo 

x—+a 

lim /(#) = oo 



lim/(;c) 

X J. o 

lim /(a:) 
lim /(*) 

a; t a 

lim /(*) 

a: — > oo 

lim /(*) 



92 
92 



sup A 112 

lub4 112 

infil 112 

gib 4 112 

ihn ^ 121 
lim sup ^4 121 

lim A 121 

/'(a) 127 
/' 127 
df(x) 



130 



131 



dx 
df(x) 

dx x=a 
f" 137 
/"' 137 
f» 137 

'» 

/-» 201 
*(/,«,*) 214 
215 

£/(/,/>) 215 



219 



/.'/(*) & 



L \j 249 
u/ a V 249 
'/ 254 
' f(x) dx 254 
/ 254 

oo J 

f 254 

oo J 

sin 0 257 
sin r 257 
7T 258 
A(x) 259 
cos 259, 261 
sin 259, 261 
sec 263 
tan 263 
esc 263 
cot 263 
arcsin 263 
arccos 264 
arc tan 265 
t(f,P) 275 
£(*) 276 
log 285 
exp 287 
e 287 
e 288 
a* 288 
log„ 289 
sinh 296 
cosh 296 
tanh 296 
arg sinh 296 
arg tanh 296 
arg cosh 296 
Nap log 299 

F(x) * 302 

// 303 
)f(x) dx 303 
r(x) 327 

Pn,a 334 
/>»,«,/ 334 
Rn,a 343 
f or 



225 



(:) 



{a n 



357 
372 



Glossary of Symbols 



lim a n = oo 376 

n— > oo 

7 382 



lim a n 373 C 438 e D 479 

* 441 A 479 

\z\ 441 f>n 481 

Re 448 482 

Im 448 + 487, 497 

lim x n 385 ^ 449 . 4g7) 501 

17m sup x n 385 Um/(z) 449 0 487,498 

n-» *-*« 1 488, 502 

lim x„ 385 /'(«) 458 _ a 488> 498 

^ sin 470 a- 1 488, 502 

lim inf x„ 385 cos 470 p 489 

exp 470 > 490, 496 

b n 478 < 490,496 

y a n 389 *» 479 > 490 > 496 

Ll - D 479 < 490, 496 



N(n; a, b) 386 



n = l 



i 433,439 Z>* 479 |«| 501 
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